Apr 12 06:15:23 user devstack@n-api.service[62039]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 06:15:23 user devstack@n-api.service[62039]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 06:15:23 2023] *** Apr 12 06:15:23 user devstack@n-api.service[62039]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 06:15:23 user devstack@n-api.service[62039]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 06:15:23 user devstack@n-api.service[62039]: nodename: user Apr 12 06:15:23 user devstack@n-api.service[62039]: machine: x86_64 Apr 12 06:15:23 user devstack@n-api.service[62039]: clock source: unix Apr 12 06:15:23 user devstack@n-api.service[62039]: pcre jit disabled Apr 12 06:15:23 user devstack@n-api.service[62039]: detected number of CPU cores: 12 Apr 12 06:15:23 user devstack@n-api.service[62039]: current working directory: / Apr 12 06:15:23 user devstack@n-api.service[62039]: detected binary path: /usr/bin/uwsgi-core Apr 12 06:15:23 user devstack@n-api.service[62039]: your processes number limit is 63637 Apr 12 06:15:23 user devstack@n-api.service[62039]: your memory page size is 4096 bytes Apr 12 06:15:23 user devstack@n-api.service[62039]: detected max file descriptor number: 2048 Apr 12 06:15:23 user devstack@n-api.service[62039]: lock engine: pthread robust mutexes Apr 12 06:15:23 user devstack@n-api.service[62039]: thunder lock: enabled Apr 12 06:15:23 user devstack@n-api.service[62039]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 06:15:23 user devstack@n-api.service[62039]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 06:15:23 user devstack@n-api.service[62039]: Python main interpreter initialized at 0x561eb5619990 Apr 12 06:15:23 user devstack@n-api.service[62039]: python threads support enabled Apr 12 06:15:23 user devstack@n-api.service[62039]: your server socket listen backlog is limited to 100 connections Apr 12 06:15:23 user devstack@n-api.service[62039]: your mercy for graceful operations on workers is 90 seconds Apr 12 06:15:23 user devstack@n-api.service[62039]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 06:15:23 user devstack@n-api.service[62039]: *** Operational MODE: preforking *** Apr 12 06:15:23 user devstack@n-api.service[62039]: *** uWSGI is running in multiple interpreter mode *** Apr 12 06:15:23 user devstack@n-api.service[62039]: spawned uWSGI master process (pid: 62039) Apr 12 06:15:23 user devstack@n-api.service[62039]: spawned uWSGI worker 1 (pid: 62040, cores: 1) Apr 12 06:15:23 user devstack@n-api.service[62039]: spawned uWSGI worker 2 (pid: 62041, cores: 1) Apr 12 06:15:23 user devstack@n-api.service[62039]: spawned uWSGI worker 3 (pid: 62042, cores: 1) Apr 12 06:15:23 user devstack@n-api.service[62039]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 06:15:23 user devstack@n-api.service[62041]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 06:15:23 user devstack@n-api.service[62042]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 06:15:23 user devstack@n-api.service[62040]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 06:15:27 user devstack@n-api.service[62042]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 06:15:27 user devstack@n-api.service[62042]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 06:15:27 user devstack@n-api.service[62042]: and ``live_migration_inbound_addr`` respectively. Apr 12 06:15:27 user devstack@n-api.service[62042]: ). Its value may be silently ignored in the future. Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 06:15:27 user devstack@n-api.service[62041]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 06:15:27 user devstack@n-api.service[62041]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 06:15:27 user devstack@n-api.service[62041]: and ``live_migration_inbound_addr`` respectively. Apr 12 06:15:27 user devstack@n-api.service[62041]: ). Its value may be silently ignored in the future. Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 06:15:27 user devstack@n-api.service[62040]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 06:15:27 user devstack@n-api.service[62040]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 06:15:27 user devstack@n-api.service[62040]: and ``live_migration_inbound_addr`` respectively. Apr 12 06:15:27 user devstack@n-api.service[62040]: ). Its value may be silently ignored in the future. Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62041) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62042) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62040) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 06:15:27 user devstack@n-api.service[62041]: INFO dbcounter [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Registered counter for database nova_api Apr 12 06:15:27 user devstack@n-api.service[62042]: INFO dbcounter [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Registered counter for database nova_api Apr 12 06:15:27 user devstack@n-api.service[62040]: INFO dbcounter [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Registered counter for database nova_api Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_db.sqlalchemy.engines [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62041) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_db.sqlalchemy.engines [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62042) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writer thread running {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writer thread running {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_db.sqlalchemy.engines [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62040) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writer thread running {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG nova.context [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),453065c2-4bc8-4fda-9e5a-4e25f602658d(cell1) {{(pid=62041) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG nova.context [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),453065c2-4bc8-4fda-9e5a-4e25f602658d(cell1) {{(pid=62042) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:15:27 user devstack@n-api.service[62041]: INFO dbcounter [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Registered counter for database nova_cell0 Apr 12 06:15:27 user devstack@n-api.service[62042]: INFO dbcounter [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Registered counter for database nova_cell0 Apr 12 06:15:27 user devstack@n-api.service[62041]: INFO dbcounter [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Registered counter for database nova_cell1 Apr 12 06:15:27 user devstack@n-api.service[62042]: INFO dbcounter [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Registered counter for database nova_cell1 Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG nova.context [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),453065c2-4bc8-4fda-9e5a-4e25f602658d(cell1) {{(pid=62040) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_db.sqlalchemy.engines [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62041) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writer thread running {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_db.sqlalchemy.engines [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62041) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_db.sqlalchemy.engines [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62042) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: INFO dbcounter [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Registered counter for database nova_cell0 Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writer thread running {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62040]: INFO dbcounter [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Registered counter for database nova_cell1 Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_db.sqlalchemy.engines [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62042) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_db.sqlalchemy.engines [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62040) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_db.sqlalchemy.engines [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62040) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writer thread running {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writer thread running {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62041]: INFO dbcounter [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Registered counter for database nova_cell0 Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writer thread running {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG oslo_db.sqlalchemy.engines [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62041) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62042]: INFO dbcounter [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Registered counter for database nova_cell0 Apr 12 06:15:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writer thread running {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writer thread running {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG oslo_db.sqlalchemy.engines [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62042) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writer thread running {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:27 user devstack@n-api.service[62040]: INFO dbcounter [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Registered counter for database nova_cell0 Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG oslo_db.sqlalchemy.engines [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62040) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 06:15:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writer thread running {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 06:15:28 user devstack@n-api.service[62041]: WARNING keystonemiddleware.auth_token [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 06:15:28 user devstack@n-api.service[62041]: WARNING keystonemiddleware.auth_token [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 06:15:28 user devstack@n-api.service[62040]: WARNING keystonemiddleware.auth_token [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 06:15:28 user devstack@n-api.service[62040]: WARNING keystonemiddleware.auth_token [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 06:15:28 user devstack@n-api.service[62042]: WARNING keystonemiddleware.auth_token [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 06:15:28 user devstack@n-api.service[62041]: WARNING keystonemiddleware.auth_token [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 06:15:28 user devstack@n-api.service[62041]: WARNING keystonemiddleware.auth_token [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 06:15:28 user devstack@n-api.service[62042]: WARNING keystonemiddleware.auth_token [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 06:15:28 user devstack@n-api.service[62041]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eb5619990 pid: 62041 (default app) Apr 12 06:15:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:15:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001466 Apr 12 06:15:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 06:15:28 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:15:28 user devstack@n-api.service[62040]: WARNING keystonemiddleware.auth_token [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 06:15:28 user devstack@n-api.service[62040]: WARNING keystonemiddleware.auth_token [None req-bc029f3d-3a73-45ae-96be-d8ae380e479b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 06:15:28 user devstack@n-api.service[62040]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eb5619990 pid: 62040 (default app) Apr 12 06:15:28 user devstack@n-api.service[62042]: WARNING keystonemiddleware.auth_token [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 06:15:28 user devstack@n-api.service[62042]: WARNING keystonemiddleware.auth_token [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 06:15:28 user devstack@n-api.service[62042]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eb5619990 pid: 62042 (default app) Apr 12 06:17:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-124b6201-006c-4e57-b38b-b911a9bbd238 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001593 Apr 12 06:17:35 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5e111fed-2061-470e-a87e-0afb378f8ae6 admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5e111fed-2061-470e-a87e-0afb378f8ae6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.378924 Apr 12 06:17:36 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 06:17:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.004432 Apr 12 06:17:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:38 2023] GET /compute/v2.1 => generated 387 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d2a06436-8f86-439b-b610-330bf8bc2a3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "swap": 0, "disk": 1, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d2a06436-8f86-439b-b610-330bf8bc2a3a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.389047 Apr 12 06:17:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:38 2023] POST /compute/v2.1/flavors => generated 405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-09f2b595-e54b-44f7-bebf-7a42f2c5e91c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-09f2b595-e54b-44f7-bebf-7a42f2c5e91c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048028 Apr 12 06:17:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 06:17:38 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001343 Apr 12 06:17:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f7fa9f0f-8715-49da-92de-9532b895ad56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "id": "d1", "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f7fa9f0f-8715-49da-92de-9532b895ad56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074201 Apr 12 06:17:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:40 2023] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c2cf13fa-51b5-4293-8663-10643bb2c3b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c2cf13fa-51b5-4293-8663-10643bb2c3b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029005 Apr 12 06:17:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 06:17:40 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001285 Apr 12 06:17:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-62bd47a7-c2b0-492d-922a-ab4857d53105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-62bd47a7-c2b0-492d-922a-ab4857d53105 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067556 Apr 12 06:17:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:42 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8c01cff5-b1df-434f-9896-8e6b29cb3629 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-8c01cff5-b1df-434f-9896-8e6b29cb3629 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027286 Apr 12 06:17:42 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 06:17:42 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001354 Apr 12 06:17:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4399be22-1017-4724-b735-bd8727594bf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "swap": 0}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4399be22-1017-4724-b735-bd8727594bf0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061412 Apr 12 06:17:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0c1777e1-8fc6-4fa3-9708-b8203416dc6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0c1777e1-8fc6-4fa3-9708-b8203416dc6d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027380 Apr 12 06:17:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 06:17:44 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001327 Apr 12 06:17:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3020c3da-a1c8-4e11-b074-fe4c01476f6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3020c3da-a1c8-4e11-b074-fe4c01476f6b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060952 Apr 12 06:17:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026694 Apr 12 06:17:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 06:17:46 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:48 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0b27f994-8ee4-44d8-95ac-9e9932ddf709 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001298 Apr 12 06:17:48 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:48 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1f673807-7046-4db7-b7bb-34e72b672489 admin admin] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:48 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1f673807-7046-4db7-b7bb-34e72b672489 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069659 Apr 12 06:17:48 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 06:17:48 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:17:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001812 Apr 12 06:17:50 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:50 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:50 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:50 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:50 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:17:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9bc36583-e8b7-4b7d-bcc1-365887b4f37f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "vcpus": 1, "ram": 512, "id": "1", "swap": 0}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9bc36583-e8b7-4b7d-bcc1-365887b4f37f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.353032 Apr 12 06:17:51 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:50 2023] POST /compute/v2.1/flavors => generated 400 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:51 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6009d7b1-e5f5-4275-a267-58daf26f7bef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6009d7b1-e5f5-4275-a267-58daf26f7bef admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046193 Apr 12 06:17:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 06:17:51 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001681 Apr 12 06:17:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-59794eff-a9da-402b-bf98-5dadd17c68fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-59794eff-a9da-402b-bf98-5dadd17c68fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.073859 Apr 12 06:17:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:53 2023] POST /compute/v2.1/flavors => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:53 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d53fd2d6-aacf-4929-838f-224cf3d484d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d53fd2d6-aacf-4929-838f-224cf3d484d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026648 Apr 12 06:17:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 06:17:53 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001594 Apr 12 06:17:55 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:55 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:55 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dd2f4c8d-0ba8-4a34-affd-64db7e5a7993 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-dd2f4c8d-0ba8-4a34-affd-64db7e5a7993 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074483 Apr 12 06:17:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:55 2023] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9ca984e2-f1eb-4e28-adf4-3504290db0d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9ca984e2-f1eb-4e28-adf4-3504290db0d0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036358 Apr 12 06:17:55 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 06:17:55 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:57 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001715 Apr 12 06:17:57 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:57 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-b5796b16-a6dc-4d92-9fcf-7967a6980a34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:57 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-b5796b16-a6dc-4d92-9fcf-7967a6980a34 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067767 Apr 12 06:17:57 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 06:17:57 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f01305f8-6712-4cca-b5cd-d6d144a7bb14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:57 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f01305f8-6712-4cca-b5cd-d6d144a7bb14 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029046 Apr 12 06:17:57 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 06:17:57 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:17:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:17:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001598 Apr 12 06:17:59 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 06:17:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:17:59 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9d41293c-4d8d-4da7-94e3-e96ec6b6bbd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:59 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9d41293c-4d8d-4da7-94e3-e96ec6b6bbd3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067116 Apr 12 06:17:59 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 06:17:59 2023] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:17:59 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0394a67b-e5ec-4e17-8685-004ba74415d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:17:59 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0394a67b-e5ec-4e17-8685-004ba74415d3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024237 Apr 12 06:17:59 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 06:17:59 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:18:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:18:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde43f0f-a7b8-40e3-8a6a-cd6e36a579ff admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002788 Apr 12 06:18:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 06:18:29 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:18:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:18:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.092815 Apr 12 06:18:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 06:18:29 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:19:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0394a67b-e5ec-4e17-8685-004ba74415d3 admin admin] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:19:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0394a67b-e5ec-4e17-8685-004ba74415d3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001511 Apr 12 06:19:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 06:19:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:19:01 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:19:01 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c2fad41d-ba54-4115-9dc1-1e719bd619a1 admin admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:19:01 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c2fad41d-ba54-4115-9dc1-1e719bd619a1 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068608 Apr 12 06:19:01 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 06:19:01 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:19:05 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:19:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 12 06:19:05 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 06:19:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:19:05 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:19:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ad166316-2d27-449a-a5da-9444156a2f69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 128, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "42", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.nano", "vcpus": 1}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:19:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ad166316-2d27-449a-a5da-9444156a2f69 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070964 Apr 12 06:19:05 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 06:19:05 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:19:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2b6581d4-98a3-42ee-9f0a-0a784f6e9c5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:19:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2b6581d4-98a3-42ee-9f0a-0a784f6e9c5a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029657 Apr 12 06:19:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 06:19:05 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:19:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:19:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-5f609e19-4c0f-4ca3-bee3-bf07fa42ca8c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001315 Apr 12 06:19:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 06:19:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:19:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-be295fe4-286d-4c64-8fde-6192a10e0d0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 192, "id": "84", "vcpus": 1, "swap": 0, "disk": 1}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:19:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-be295fe4-286d-4c64-8fde-6192a10e0d0d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073817 Apr 12 06:19:09 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 06:19:09 2023] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:19:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-51c82cff-3215-43ef-99ce-2d6ace237e00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:19:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-51c82cff-3215-43ef-99ce-2d6ace237e00 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028218 Apr 12 06:19:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 06:19:09 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-24f48c7e-bb64-47bc-a604-9137bee33a12 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Action: 'create', calling method: .version_select at 0x7fd24ec6b0a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1461328518", "metadata": {"Type": "work"}}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-24f48c7e-bb64-47bc-a604-9137bee33a12 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Request method failure captured: Apr 12 06:21:21 user devstack@n-api.service[62042]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 06:21:21 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:21:21 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:21:21 user devstack@n-api.service[62042]: Connection: close Apr 12 06:21:21 user devstack@n-api.service[62042]: Content-Length: 122 Apr 12 06:21:21 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:21:21 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:21:21 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:21:21 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk3hJXusATZuoCpZa_Ymem2QgZLXOnk5g2pBmsIl2jnmbHkgUi2h0DWZerLCcUl4kLT_3_jeEI6iSC-aWhSuyofYR7QiJwQ3a13mJZJecQO_isQ3AVPPStyLja5aYA5WKdkBqjrfNTuRzpTEM-8S5ZWRx5kYJVbhSvGpNeDw4B1fjPQ Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Project-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}] Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Tenant-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:21 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62042]: X-User: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:21 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:21:21 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:21:21 user devstack@n-api.service[62042]: X-User-Id: 2a14578cb7cd441797457bf601cdba4a Apr 12 06:21:21 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:21 user devstack@n-api.service[62042]: Apr 12 06:21:21 user devstack@n-api.service[62042]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1461328518", "metadata": {"Type": "work"}}} Apr 12 06:21:21 user devstack@n-api.service[62042]: method: Apr 12 06:21:21 user devstack@n-api.service[62042]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62042]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1461328518', 'metadata': {'Type': 'work'}}}} Apr 12 06:21:21 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise error Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-24f48c7e-bb64-47bc-a604-9137bee33a12 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:21:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-24f48c7e-bb64-47bc-a604-9137bee33a12 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.379056 Apr 12 06:21:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 06:21:21 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 381 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:21:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-13f8ad8d-6aed-469e-8c41-64f80308279c tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Action: 'create', calling method: .version_select at 0x7fd24ecd2dd0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1860943698", "metadata": {"Type": "work"}}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-13f8ad8d-6aed-469e-8c41-64f80308279c tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Request method failure captured: Apr 12 06:21:21 user devstack@n-api.service[62041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 06:21:21 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:21:21 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:21:21 user devstack@n-api.service[62041]: Connection: close Apr 12 06:21:21 user devstack@n-api.service[62041]: Content-Length: 120 Apr 12 06:21:21 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:21:21 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:21:21 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:21:21 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3hJXusATZuoCpZa_Ymem2QgZLXOnk5g2pBmsIl2jnmbHkgUi2h0DWZerLCcUl4kLT_3_jeEI6iSC-aWhSuyofYR7QiJwQ3a13mJZJecQO_isQ3AVPPStyLja5aYA5WKdkBqjrfNTuRzpTEM-8S5ZWRx5kYJVbhSvGpNeDw4B1fjPQ Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Project-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Project-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}] Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Tenant: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Tenant-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:21 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62041]: X-User: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:21 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:21:21 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:21:21 user devstack@n-api.service[62041]: X-User-Id: 2a14578cb7cd441797457bf601cdba4a Apr 12 06:21:21 user devstack@n-api.service[62041]: X-User-Name: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:21 user devstack@n-api.service[62041]: Apr 12 06:21:21 user devstack@n-api.service[62041]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1860943698", "metadata": {"Type": "work"}}} Apr 12 06:21:21 user devstack@n-api.service[62041]: method: Apr 12 06:21:21 user devstack@n-api.service[62041]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 06:21:21 user devstack@n-api.service[62041]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1860943698', 'metadata': {'Type': 'work'}}}} Apr 12 06:21:21 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise error Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi '0' Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 06:21:21 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-13f8ad8d-6aed-469e-8c41-64f80308279c tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:21:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-13f8ad8d-6aed-469e-8c41-64f80308279c tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014405 Apr 12 06:21:21 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 06:21:21 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:21:21 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d059e25a-deb5-4d7e-86cd-c34ff91039b0 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Action: 'create', calling method: .version_select at 0x7fd24ee87250>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-818226612", "metadata": {"Type": "work"}}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d059e25a-deb5-4d7e-86cd-c34ff91039b0 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Request method failure captured: Apr 12 06:21:21 user devstack@n-api.service[62040]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 06:21:21 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:21:21 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:21:21 user devstack@n-api.service[62040]: Connection: close Apr 12 06:21:21 user devstack@n-api.service[62040]: Content-Length: 118 Apr 12 06:21:21 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:21:21 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:21:21 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:21:21 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk3hJXusATZuoCpZa_Ymem2QgZLXOnk5g2pBmsIl2jnmbHkgUi2h0DWZerLCcUl4kLT_3_jeEI6iSC-aWhSuyofYR7QiJwQ3a13mJZJecQO_isQ3AVPPStyLja5aYA5WKdkBqjrfNTuRzpTEM-8S5ZWRx5kYJVbhSvGpNeDw4B1fjPQ Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Project-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}] Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Tenant-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:21 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:21 user devstack@n-api.service[62040]: X-User: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:21 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:21:21 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:21:21 user devstack@n-api.service[62040]: X-User-Id: 2a14578cb7cd441797457bf601cdba4a Apr 12 06:21:21 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:21 user devstack@n-api.service[62040]: Apr 12 06:21:21 user devstack@n-api.service[62040]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-818226612", "metadata": {"Type": "work"}}} Apr 12 06:21:21 user devstack@n-api.service[62040]: method: Apr 12 06:21:21 user devstack@n-api.service[62040]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62040]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-818226612', 'metadata': {'Type': 'work'}}}} Apr 12 06:21:21 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise error Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi '' Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 06:21:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:21:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d059e25a-deb5-4d7e-86cd-c34ff91039b0 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:21:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d059e25a-deb5-4d7e-86cd-c34ff91039b0 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015775 Apr 12 06:21:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 06:21:21 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:21:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ce258787-b8e4-4607-9557-7e7fe58a44e7 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Calling method '.version_select at 0x7fd24ecb8940>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-ce258787-b8e4-4607-9557-7e7fe58a44e7 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] HTTP exception thrown: Volume tempest-invalid-823502660 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ce258787-b8e4-4607-9557-7e7fe58a44e7 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Request method failure captured: Apr 12 06:21:22 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-823502660 HTTP/1.1 Apr 12 06:21:22 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:21:22 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:21:22 user devstack@n-api.service[62042]: Connection: close Apr 12 06:21:22 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:21:22 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:21:22 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:21:22 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:21:22 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk3hJXusATZuoCpZa_Ymem2QgZLXOnk5g2pBmsIl2jnmbHkgUi2h0DWZerLCcUl4kLT_3_jeEI6iSC-aWhSuyofYR7QiJwQ3a13mJZJecQO_isQ3AVPPStyLja5aYA5WKdkBqjrfNTuRzpTEM-8S5ZWRx5kYJVbhSvGpNeDw4B1fjPQ Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}] Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Tenant-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Id: 2a14578cb7cd441797457bf601cdba4a Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:22 user devstack@n-api.service[62042]: method: Apr 12 06:21:22 user devstack@n-api.service[62042]: exception: Volume tempest-invalid-823502660 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: action_args: {'id': 'tempest-invalid-823502660'} Apr 12 06:21:22 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-823502660 could not be found. (HTTP 404) (Request-ID: req-332569f5-5b7b-408c-9f32-e3040741127e) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-823502660 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-823502660 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-823502660 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ce258787-b8e4-4607-9557-7e7fe58a44e7 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Returning 404 to user: Volume tempest-invalid-823502660 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:21:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ce258787-b8e4-4607-9557-7e7fe58a44e7 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-823502660" status: 404 len: 98 microversion: 2.1 time: 0.670290 Apr 12 06:21:22 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 06:21:21 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-823502660 => generated 98 bytes in 672 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 06:21:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-84e0c9dc-95e3-47f4-8895-0c9730d2e7a7 tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005398 Apr 12 06:21:22 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 06:21:22 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 06:21:22 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-63c933f3-8f9a-41a3-a906-e3ad3ed888ee tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004722 Apr 12 06:21:22 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 06:21:22 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 06:21:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cb8405eb-8caa-47b9-9b56-0e05b77c4a1b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Calling method '.version_select at 0x7fd24eb2a290>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-cb8405eb-8caa-47b9-9b56-0e05b77c4a1b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] HTTP exception thrown: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cb8405eb-8caa-47b9-9b56-0e05b77c4a1b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Request method failure captured: Apr 12 06:21:22 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/os-volumes/f6c82e14-45d9-4616-a140-61960b54f9f9 HTTP/1.1 Apr 12 06:21:22 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:21:22 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:21:22 user devstack@n-api.service[62042]: Connection: close Apr 12 06:21:22 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:21:22 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:21:22 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:21:22 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:21:22 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk3hJXusATZuoCpZa_Ymem2QgZLXOnk5g2pBmsIl2jnmbHkgUi2h0DWZerLCcUl4kLT_3_jeEI6iSC-aWhSuyofYR7QiJwQ3a13mJZJecQO_isQ3AVPPStyLja5aYA5WKdkBqjrfNTuRzpTEM-8S5ZWRx5kYJVbhSvGpNeDw4B1fjPQ Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}] Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Tenant-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:22 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Id: 2a14578cb7cd441797457bf601cdba4a Apr 12 06:21:22 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:22 user devstack@n-api.service[62042]: method: Apr 12 06:21:22 user devstack@n-api.service[62042]: exception: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: action_args: {'id': 'f6c82e14-45d9-4616-a140-61960b54f9f9'} Apr 12 06:21:22 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. (HTTP 404) (Request-ID: req-41d0938d-0bce-429c-8a16-6ba5b04fca6a) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cb8405eb-8caa-47b9-9b56-0e05b77c4a1b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Returning 404 to user: Volume f6c82e14-45d9-4616-a140-61960b54f9f9 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:21:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-cb8405eb-8caa-47b9-9b56-0e05b77c4a1b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f6c82e14-45d9-4616-a140-61960b54f9f9" status: 404 len: 109 microversion: 2.1 time: 0.147074 Apr 12 06:21:22 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:21:22 2023] DELETE /compute/v2.1/os-volumes/f6c82e14-45d9-4616-a140-61960b54f9f9 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:21:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-48634d6c-2ce6-42d5-aa9c-077e00b9848b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Calling method '.version_select at 0x7fd24ecd1870>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-48634d6c-2ce6-42d5-aa9c-077e00b9848b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] HTTP exception thrown: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-48634d6c-2ce6-42d5-aa9c-077e00b9848b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Request method failure captured: Apr 12 06:21:22 user devstack@n-api.service[62041]: request: GET /compute/v2.1/os-volumes/d0ce0b4e-06e9-497a-8368-3f11b986aed4 HTTP/1.1 Apr 12 06:21:22 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:21:22 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:21:22 user devstack@n-api.service[62041]: Connection: close Apr 12 06:21:22 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:21:22 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:21:22 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:21:22 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:21:22 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3hJXusATZuoCpZa_Ymem2QgZLXOnk5g2pBmsIl2jnmbHkgUi2h0DWZerLCcUl4kLT_3_jeEI6iSC-aWhSuyofYR7QiJwQ3a13mJZJecQO_isQ3AVPPStyLja5aYA5WKdkBqjrfNTuRzpTEM-8S5ZWRx5kYJVbhSvGpNeDw4B1fjPQ Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Project-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Project-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8eaab854bcb749f189ba90d5f845559a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8eaab854bcb749f189ba90d5f845559a"}]}] Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Tenant: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Tenant-Id: 8eaab854bcb749f189ba90d5f845559a Apr 12 06:21:22 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-VolumesNegativeTest-1161756138 Apr 12 06:21:22 user devstack@n-api.service[62041]: X-User: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:22 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:21:22 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:21:22 user devstack@n-api.service[62041]: X-User-Id: 2a14578cb7cd441797457bf601cdba4a Apr 12 06:21:22 user devstack@n-api.service[62041]: X-User-Name: tempest-VolumesNegativeTest-1161756138-project-member Apr 12 06:21:22 user devstack@n-api.service[62041]: method: Apr 12 06:21:22 user devstack@n-api.service[62041]: exception: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62041]: action_args: {'id': 'd0ce0b4e-06e9-497a-8368-3f11b986aed4'} Apr 12 06:21:22 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. (HTTP 404) (Request-ID: req-8ad7a65b-8fc6-47da-bc83-227eeea9f0ec) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. Apr 12 06:21:22 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:21:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-48634d6c-2ce6-42d5-aa9c-077e00b9848b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] Returning 404 to user: Volume d0ce0b4e-06e9-497a-8368-3f11b986aed4 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:21:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-48634d6c-2ce6-42d5-aa9c-077e00b9848b tempest-VolumesNegativeTest-1161756138 tempest-VolumesNegativeTest-1161756138-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d0ce0b4e-06e9-497a-8368-3f11b986aed4" status: 404 len: 109 microversion: 2.1 time: 0.256291 Apr 12 06:21:22 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:21:22 2023] GET /compute/v2.1/os-volumes/d0ce0b4e-06e9-497a-8368-3f11b986aed4 => generated 109 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:21:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2118576466", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "c388c547-af8b-4a08-a268-43eb751fa0c1"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:33 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] validate_networks() for [('c388c547-af8b-4a08-a268-43eb751fa0c1', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Getting quotas for project fbca90b5b5fb49ca857aa4e215a99e37. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Getting quotas for user e761442395d14d7f82216e3d4174e43a and project fbca90b5b5fb49ca857aa4e215a99e37. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:21:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:21:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.169479 Apr 12 06:21:36 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:21:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 3172 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:21:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-20d5e233-2409-40d8-8906-091ab8d8b786 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:36 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-20d5e233-2409-40d8-8906-091ab8d8b786 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:21:36 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-20d5e233-2409-40d8-8906-091ab8d8b786 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:21:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-20d5e233-2409-40d8-8906-091ab8d8b786 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1211 microversion: 2.1 time: 0.145171 Apr 12 06:21:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:21:36 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1211 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:21:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-177cb83e-b012-4660-9ea9-01bb8dfa3bf7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: .version_select at 0x7fd24ea003a0>, body: {"keypair": {"name": "tempest-keypair-673948167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg=="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:37 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-177cb83e-b012-4660-9ea9-01bb8dfa3bf7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for project 4f124d62c4d345d9af22f1557abca276. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:21:37 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-177cb83e-b012-4660-9ea9-01bb8dfa3bf7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for user d58cc232d0094bebacf147c6b61a0989 and project 4f124d62c4d345d9af22f1557abca276. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:21:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-177cb83e-b012-4660-9ea9-01bb8dfa3bf7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.412898 Apr 12 06:21:37 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:21:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4dfd7d39-17e5-46ff-bbc6-2e4bfe177a51 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'create', calling method: .version_select at 0x7fd24ebeb400>, body: {"keypair": {"name": "tempest-keypair-1698395184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:44 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-4dfd7d39-17e5-46ff-bbc6-2e4bfe177a51 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:21:44 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-4dfd7d39-17e5-46ff-bbc6-2e4bfe177a51 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:21:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4dfd7d39-17e5-46ff-bbc6-2e4bfe177a51 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360697 Apr 12 06:21:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:21:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-347561886", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8173354d-cba7-49f6-8229-6c9ee13ddb0f"}], "security_groups": [{"name": "tempest-securitygroup--704733086"}], "key_name": "tempest-keypair-673948167", "user_data": "}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:45 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] validate_networks() for [('8173354d-cba7-49f6-8229-6c9ee13ddb0f', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:46 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:46 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b32f3f-86c4-450a-a710-7d0c05ea4097", "tag": "33f085d7-b843-4c48-8379-a5c2690a4231"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-61268901", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "4f730b67-77d8-4694-9f2d-9c91555a540e"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for project 4f124d62c4d345d9af22f1557abca276. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for user d58cc232d0094bebacf147c6b61a0989 and project 4f124d62c4d345d9af22f1557abca276. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:21:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Creating event network-changed:33f085d7-b843-4c48-8379-a5c2690a4231 for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 on user Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62041) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Acquired lock "compute-rpcapi-router" {{(pid=62041) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:21:46 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:21:46 user devstack@n-api.service[62041]: INFO nova.compute.rpcapi [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] Releasing lock "compute-rpcapi-router" {{(pid=62041) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 06:21:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e1cf3aab-75e0-471e-a30e-3008a548b185 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284639 Apr 12 06:21:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 21/58] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:46 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] validate_networks() for [('4f730b67-77d8-4694-9f2d-9c91555a540e', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:21:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.946321 Apr 12 06:21:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 19/59] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:21:44 2023] POST /compute/v2.1/servers => generated 399 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9e8a0b1f-8e32-4c1b-8606-83243b72f7a7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9e8a0b1f-8e32-4c1b-8606-83243b72f7a7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:21:47 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-9e8a0b1f-8e32-4c1b-8606-83243b72f7a7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:21:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9e8a0b1f-8e32-4c1b-8606-83243b72f7a7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1230 microversion: 2.1 time: 0.144329 Apr 12 06:21:47 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 22/60] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:21:46 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1230 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Getting quotas for project e474b11e55eb45ff91f140aae7e2981d. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Getting quotas for user ee2e2b19e9dd4d578a38e1ddec680b5d and project e474b11e55eb45ff91f140aae7e2981d. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:21:48 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:21:48 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.650615 Apr 12 06:21:48 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:21:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:21:48 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-865929d8-4a3f-4895-af54-96427dba69b8 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:48 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-865929d8-4a3f-4895-af54-96427dba69b8 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:21:48 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-865929d8-4a3f-4895-af54-96427dba69b8 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e2b19e9dd4d578a38e1ddec680b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e474b11e55eb45ff91f140aae7e2981d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:21:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-865929d8-4a3f-4895-af54-96427dba69b8 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 200 len: 1207 microversion: 2.1 time: 0.170969 Apr 12 06:21:48 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 20/62] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:21:48 2023] GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 1207 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:21:50 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1807692588", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e7da68c2-65d3-464a-9293-6e43665b2422"}], "security_groups": [{"name": "tempest-securitygroup--1531003226"}], "key_name": "tempest-keypair-1698395184", "user_data": "}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:50 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] validate_networks() for [('e7da68c2-65d3-464a-9293-6e43665b2422', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:21:52 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:21:52 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.058964 Apr 12 06:21:52 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 23/63] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:21:50 2023] POST /compute/v2.1/servers => generated 407 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:21:52 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-082f67f9-9b66-4b76-be50-e900269e06e6 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:21:52 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-082f67f9-9b66-4b76-be50-e900269e06e6 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:21:52 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-082f67f9-9b66-4b76-be50-e900269e06e6 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:21:52 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-082f67f9-9b66-4b76-be50-e900269e06e6 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1233 microversion: 2.1 time: 0.323932 Apr 12 06:21:52 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:21:52 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1233 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b32f3f-86c4-450a-a710-7d0c05ea4097", "name": "network-vif-plugged", "status": "completed", "tag": "33f085d7-b843-4c48-8379-a5c2690a4231"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:53 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Creating event network-vif-plugged:33f085d7-b843-4c48-8379-a5c2690a4231 for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 on user Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62042) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62042) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:53 user devstack@n-api.service[62042]: INFO nova.compute.rpcapi [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 06:21:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] Releasing lock "compute-rpcapi-router" {{(pid=62042) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 06:21:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-2d08a0c3-3ed9-4d97-8b8c-976f6ebfd1e1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409621 Apr 12 06:21:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Creating event network-changed:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:21:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345968 Apr 12 06:21:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 24/66] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149703ba-0e5a-46f3-b988-d864de1c2137", "tag": "9c356d39-d585-49ef-82de-d123a1d5e0d6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Creating event network-changed:9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance 149703ba-0e5a-46f3-b988-d864de1c2137 on user Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62040) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62040) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:54 user devstack@n-api.service[62040]: INFO nova.compute.rpcapi [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 06:21:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] Releasing lock "compute-rpcapi-router" {{(pid=62040) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 06:21:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a8e8d624-e378-4eb9-a243-af55e5b831fa None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171117 Apr 12 06:21:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:55 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b32f3f-86c4-450a-a710-7d0c05ea4097", "name": "network-vif-plugged", "status": "completed", "tag": "33f085d7-b843-4c48-8379-a5c2690a4231"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Creating event network-vif-plugged:33f085d7-b843-4c48-8379-a5c2690a4231 for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 on user Apr 12 06:21:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066327 Apr 12 06:21:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:21:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:21:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064028 Apr 12 06:21:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:21:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:21:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052162 Apr 12 06:21:58 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:21:58 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149703ba-0e5a-46f3-b988-d864de1c2137", "name": "network-vif-plugged", "status": "completed", "tag": "9c356d39-d585-49ef-82de-d123a1d5e0d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:21:58 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:21:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:21:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:21:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:21:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Creating event network-vif-plugged:9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance 149703ba-0e5a-46f3-b988-d864de1c2137 on user Apr 12 06:21:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045116 Apr 12 06:21:58 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149703ba-0e5a-46f3-b988-d864de1c2137", "name": "network-vif-plugged", "status": "completed", "tag": "9c356d39-d585-49ef-82de-d123a1d5e0d6"}, {"name": "network-changed", "server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Creating event network-vif-plugged:9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance 149703ba-0e5a-46f3-b988-d864de1c2137 on user Apr 12 06:22:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Creating event network-changed:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:22:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050966 Apr 12 06:22:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 26/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=18 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:06 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:22:06 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045901 Apr 12 06:22:06 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:07 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8cdb9490-b92f-48c6-90de-02a9c3d8411f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Action: 'create', calling method: .version_select at 0x7fd24eaa39a0>, body: {"keypair": {"name": "tempest-keypair-939806397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNu4v/bMjQCtjIiU2fQv/kMUV5IAIKUk3uEo2wdL9cZG/02bIvxNngSgUc7czWm6vruLEHX+C9lIzuK/6LvCcBfbYsBmwF7wSXtfMfN1bdsxihIjrXNuhUi2OQoWZocEg=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:08 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-8cdb9490-b92f-48c6-90de-02a9c3d8411f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Getting quotas for project 94e95975f26a4677b628411ddb18c68c. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:08 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-8cdb9490-b92f-48c6-90de-02a9c3d8411f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Getting quotas for user de02e22a24944fdf952fd302b608a293 and project 94e95975f26a4677b628411ddb18c68c. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8cdb9490-b92f-48c6-90de-02a9c3d8411f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.508124 Apr 12 06:22:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 24/74] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:22:07 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=13 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:22:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087143 Apr 12 06:22:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2eac8e13-521d-440a-b232-27cc673aa146 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Action: 'create', calling method: .version_select at 0x7fd24e29b250>, body: {"keypair": {"name": "tempest-keypair-1020989553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:09 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-2eac8e13-521d-440a-b232-27cc673aa146 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Getting quotas for project 96d2a1b102d54e8194741137e193436f. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:09 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-2eac8e13-521d-440a-b232-27cc673aa146 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Getting quotas for user 896e1c5d0edd4a1d9d122115f02dfef7 and project 96d2a1b102d54e8194741137e193436f. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2eac8e13-521d-440a-b232-27cc673aa146 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.148003 Apr 12 06:22:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 25/76] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 06:22:09 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:22:11 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-196824245", "imageRef": "28c48af4-828a-49f8-850e-cec50c5957dd", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "6e696563-b74d-4d06-adb9-004d4c9e108d"}], "security_groups": [{"name": "tempest-securitygroup--63416293"}], "key_name": "tempest-keypair-939806397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:11 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:11 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] validate_networks() for [('6e696563-b74d-4d06-adb9-004d4c9e108d', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-535299913", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "00422635-29f9-424b-99fd-93e32fe08520"}], "security_groups": [{"name": "tempest-securitygroup--604699819"}], "key_name": "tempest-keypair-1020989553", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Getting quotas for project 94e95975f26a4677b628411ddb18c68c. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Getting quotas for user de02e22a24944fdf952fd302b608a293 and project 94e95975f26a4677b628411ddb18c68c. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='28c48af4-828a-49f8-850e-cec50c5957dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] validate_networks() for [('00422635-29f9-424b-99fd-93e32fe08520', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:22:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.912676 Apr 12 06:22:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 25/77] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:22:11 2023] POST /compute/v2.1/servers => generated 402 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:22:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0807daf7-7dc7-4a17-b1bf-c5a5c9e3ab16 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:12 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0807daf7-7dc7-4a17-b1bf-c5a5c9e3ab16 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:12 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0807daf7-7dc7-4a17-b1bf-c5a5c9e3ab16 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02e22a24944fdf952fd302b608a293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e95975f26a4677b628411ddb18c68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0807daf7-7dc7-4a17-b1bf-c5a5c9e3ab16 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 200 len: 1238 microversion: 2.1 time: 0.119557 Apr 12 06:22:12 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 26/78] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:12 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Getting quotas for project 96d2a1b102d54e8194741137e193436f. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Getting quotas for user 896e1c5d0edd4a1d9d122115f02dfef7 and project 96d2a1b102d54e8194741137e193436f. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:22:12 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:22:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.865469 Apr 12 06:22:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 28/79] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:22:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d73d457a-c838-405c-808c-b8724bc7a191 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:12 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d73d457a-c838-405c-808c-b8724bc7a191 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:13 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d73d457a-c838-405c-808c-b8724bc7a191 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:13 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d73d457a-c838-405c-808c-b8724bc7a191 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:13 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d73d457a-c838-405c-808c-b8724bc7a191 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d73d457a-c838-405c-808c-b8724bc7a191 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 200 len: 1320 microversion: 2.49 time: 0.105581 Apr 12 06:22:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:22:12 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 1320 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:22:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1c7bb7e9-239b-4fd8-897d-b18c5a678d08 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Action: 'create', calling method: .version_select at 0x7fd24e29ba30>, body: {"keypair": {"name": "tempest-keypair-1426278107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2iwubxgd67bcfbYSIQ4InvaMveVw40BYu/RkOLGoTl7STVma0BPiTSi090ksb72jogJXIn3Y1rI+7tIGtilTjYycBsCQDhXALmgJddDEyoe9QKkV0XFtcCerGg6FL8Q=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:13 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-1c7bb7e9-239b-4fd8-897d-b18c5a678d08 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Getting quotas for project ff56a846b9e34aada0c72df46d47b77d. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:13 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-1c7bb7e9-239b-4fd8-897d-b18c5a678d08 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Getting quotas for user f053ed1c99c0480c9d1b0bc466e49e08 and project ff56a846b9e34aada0c72df46d47b77d. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1c7bb7e9-239b-4fd8-897d-b18c5a678d08 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068741 Apr 12 06:22:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 27/81] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:22:13 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-2009329208", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "0b9e975b-f79a-4346-a4ba-543f9560aba7"}], "security_groups": [{"name": "tempest-securitygroup--248653735"}], "key_name": "tempest-keypair-1426278107", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] validate_networks() for [('0b9e975b-f79a-4346-a4ba-543f9560aba7', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:22:16 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:16 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Creating event network-changed:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:22:16 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042230 Apr 12 06:22:16 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:16 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Getting quotas for project ff56a846b9e34aada0c72df46d47b77d. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:17 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Getting quotas for user f053ed1c99c0480c9d1b0bc466e49e08 and project ff56a846b9e34aada0c72df46d47b77d. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:22:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:22:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.998489 Apr 12 06:22:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 29/83] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:22:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:22:17 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-75541e35-827e-41e0-b2e9-d8b84ee1f3f0 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-75541e35-827e-41e0-b2e9-d8b84ee1f3f0 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:17 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-75541e35-827e-41e0-b2e9-d8b84ee1f3f0 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f053ed1c99c0480c9d1b0bc466e49e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56a846b9e34aada0c72df46d47b77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-75541e35-827e-41e0-b2e9-d8b84ee1f3f0 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6" status: 200 len: 1226 microversion: 2.1 time: 0.103172 Apr 12 06:22:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 28/84] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:17 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Creating event network-changed:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:22:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074152 Apr 12 06:22:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:20 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "name": "network-vif-plugged", "status": "completed", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Creating event network-vif-plugged:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:22:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056349 Apr 12 06:22:20 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Creating event network-changed:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:22:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039028 Apr 12 06:22:20 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-plugged", "status": "completed", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Creating event network-vif-plugged:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:22:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 Apr 12 06:22:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 29/88] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "name": "network-vif-plugged", "status": "completed", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Creating event network-vif-plugged:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:22:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036381 Apr 12 06:22:22 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 31/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "name": "network-vif-plugged", "status": "completed", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Creating event network-vif-plugged:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:22:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075455 Apr 12 06:22:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=12 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-plugged", "status": "completed", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Creating event network-vif-plugged:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:22:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119384 Apr 12 06:22:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:25 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "name": "network-vif-plugged", "status": "completed", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Creating event network-vif-plugged:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:22:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042706 Apr 12 06:22:25 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:27 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-00591f42-1220-45ce-8970-5a6e203d876e tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1494 microversion: 2.1 time: 0.550072 Apr 12 06:22:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:26 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1494 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:38 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-43885917-54e1-4ba5-a5a6-243f0087c059 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1536 microversion: 2.1 time: 0.952393 Apr 12 06:22:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 31/94] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:37 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1536 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=11 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3e8a7020-d459-4bfc-ba9b-c890512788bc tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Action: 'create', calling method: .version_select at 0x7fd24eafe200>, body: {"keypair": {"name": "tempest-TestStampPattern-1405244377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw=="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-3e8a7020-d459-4bfc-ba9b-c890512788bc tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting quotas for project 5a7d74130d4d417a93de352381229948. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:38 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-3e8a7020-d459-4bfc-ba9b-c890512788bc tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting quotas for user d59314e79d0344a2943391c3c2ab628a and project 5a7d74130d4d417a93de352381229948. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3e8a7020-d459-4bfc-ba9b-c890512788bc tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.316052 Apr 12 06:22:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 33/95] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:22:38 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e2b19e9dd4d578a38e1ddec680b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e474b11e55eb45ff91f140aae7e2981d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-effa5c52-dd66-45df-be3b-41b1d15b9138 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 200 len: 1488 microversion: 2.1 time: 0.273288 Apr 12 06:22:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 32/96] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:38 2023] GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 1488 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a93d927e-bf6b-49a3-a1a8-22e719b65690 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Action: 'create', calling method: .version_select at 0x7fd24eaf0d30>, body: {"keypair": {"name": "tempest-keypair-1379416665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:38 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-a93d927e-bf6b-49a3-a1a8-22e719b65690 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting quotas for project e313922ba234462285d20a4f1f2d88d0. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:38 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-a93d927e-bf6b-49a3-a1a8-22e719b65690 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting quotas for user 977b800fab264446b0492c93b0dc12d3 and project e313922ba234462285d20a4f1f2d88d0. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a93d927e-bf6b-49a3-a1a8-22e719b65690 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.062581 Apr 12 06:22:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 32/97] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 06:22:38 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:22:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-235005928", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "6c8f984a-0a0e-4909-9a98-c4055a889b2b"}, {"port": "48b06cf1-3d27-423d-a0fb-952c396a727c", "tag": "port-1"}, {"port": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "tag": "port-2"}, {"uuid": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "tag": "net-1"}, {"uuid": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4"}, {"uuid": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6938de6c-91d6-44b2-af51-33e34e241f29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3d1bda7d-311d-45ff-9270-f1f4126818f3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "19059339-d01d-43bc-9939-181649d28bc6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--948018444"}], "key_name": "tempest-keypair-1379416665", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:41 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] validate_networks() for [('6c8f984a-0a0e-4909-9a98-c4055a889b2b', None, None, None, None, None), (None, None, '48b06cf1-3d27-423d-a0fb-952c396a727c', None, None, None), (None, None, '1684f1e7-b9c2-4228-8809-ebaae1ed41c7', None, None, None), ('c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4', None, None, None, None, None), ('c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4', None, None, None, None, None), ('4dc59fb9-a627-448d-a42b-937b5d2e5b00', '10.2.2.100', None, None, None, None), ('4dc59fb9-a627-448d-a42b-937b5d2e5b00', '10.2.2.200', None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:22:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-903505246", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1405244377", "security_groups": [{"name": "tempest-secgroup-smoke-1617961673"}], "networks": [{"uuid": "85180900-1c38-4677-a676-89d6643196d0"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:41 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] validate_networks() for [('85180900-1c38-4677-a676-89d6643196d0', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting quotas for project 5a7d74130d4d417a93de352381229948. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting quotas for user d59314e79d0344a2943391c3c2ab628a and project 5a7d74130d4d417a93de352381229948. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:22:42 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:22:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.846462 Apr 12 06:22:42 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 33/98] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:22:41 2023] POST /compute/v2.1/servers => generated 404 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:22:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3a5dda30-3038-4d7c-a115-4a6be33805a4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:42 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3a5dda30-3038-4d7c-a115-4a6be33805a4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:42 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3a5dda30-3038-4d7c-a115-4a6be33805a4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3a5dda30-3038-4d7c-a115-4a6be33805a4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38" status: 200 len: 1236 microversion: 2.1 time: 0.076168 Apr 12 06:22:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:42 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting quotas for project e313922ba234462285d20a4f1f2d88d0. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting quotas for user 977b800fab264446b0492c93b0dc12d3 and project e313922ba234462285d20a4f1f2d88d0. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-918f365b-388f-4b4b-9d9f-38839b5d02db tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1540 microversion: 2.1 time: 0.170655 Apr 12 06:22:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:22:43 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:22:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6938de6c-91d6-44b2-af51-33e34e241f29',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3d1bda7d-311d-45ff-9270-f1f4126818f3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19059339-d01d-43bc-9939-181649d28bc6',volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:22:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 2.895593 Apr 12 06:22:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 34/101] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 06:22:40 2023] POST /compute/v2.1/servers => generated 403 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:22:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a59d7af4-2385-4ac4-a851-09774cb58c92 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:22:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-a59d7af4-2385-4ac4-a851-09774cb58c92 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:22:43 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-a59d7af4-2385-4ac4-a851-09774cb58c92 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:43 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-a59d7af4-2385-4ac4-a851-09774cb58c92 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:43 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-a59d7af4-2385-4ac4-a851-09774cb58c92 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:22:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a59d7af4-2385-4ac4-a851-09774cb58c92 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 200 len: 1279 microversion: 2.42 time: 0.072823 Apr 12 06:22:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 34/102] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:22:43 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 1279 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:22:48 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:48 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Creating event network-changed:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:22:48 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049772 Apr 12 06:22:48 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:50 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "name": "network-vif-plugged", "status": "completed", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:50 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Creating event network-vif-plugged:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:22:50 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Apr 12 06:22:50 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:52 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}, {"server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "name": "network-vif-plugged", "status": "completed", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}, {"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "48b06cf1-3d27-423d-a0fb-952c396a727c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:52 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:52 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:52 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:52 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Creating event network-changed:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Creating event network-vif-plugged:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:22:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Creating event network-changed:48b06cf1-3d27-423d-a0fb-952c396a727c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.043415 Apr 12 06:22:52 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:54 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:54 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ef079101-5844-4b69-9d02-ca7ccb523644 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Action: 'create', calling method: .version_select at 0x7fd24e2b4310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1634672150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/XYJS5WZMk53chHKmw/+iSEEOXZF7wP3pIbC0AGTht+XIXJedtGoPTQqkFu+XBL60BEsYozXDU+97steer9vl1moNpsewzRRDuc/MQvBwxKIIaehE8Onlx0BWl81dCFA=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:54 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-ef079101-5844-4b69-9d02-ca7ccb523644 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting quotas for project c7742afa38eb46818efaf3b811c417ba. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:22:54 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-ef079101-5844-4b69-9d02-ca7ccb523644 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting quotas for user 9ed3a446901644b6a622afb3166f08dc and project c7742afa38eb46818efaf3b811c417ba. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:22:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ef079101-5844-4b69-9d02-ca7ccb523644 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.352338 Apr 12 06:22:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 36/106] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:22:54 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:54 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:54 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:54 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7"}, {"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "f984771f-43c1-4565-8e7f-34d142b19801"}, {"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "6ee43811-1303-4a84-8bd4-0de882daac34"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Creating event network-changed:1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Creating event network-changed:f984771f-43c1-4565-8e7f-34d142b19801 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Creating event network-changed:6ee43811-1303-4a84-8bd4-0de882daac34 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.053781 Apr 12 06:22:54 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:56 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb"}, {"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "22b7b070-9ef1-402f-8cbc-50684b0dad1c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:22:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:22:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:22:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Creating event network-changed:1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Creating event network-changed:22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:22:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037719 Apr 12 06:22:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 36/108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:22:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=16 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:22:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1182120878", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1634672150", "security_groups": [{"name": "tempest-secgroup-smoke-1552254618"}], "networks": [{"uuid": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12"}], "block_device_mapping_v2": [{"uuid": "d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:22:59 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] validate_networks() for [('e87d03d7-dafc-4dc8-bcd0-2c975242ad12', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting quotas for project c7742afa38eb46818efaf3b811c417ba. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting quotas for user 9ed3a446901644b6a622afb3166f08dc and project c7742afa38eb46818efaf3b811c417ba. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:23:00 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a',volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:23:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.063185 Apr 12 06:23:00 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 37/109] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:22:59 2023] POST /compute/v2.1/servers => generated 404 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:23:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-422d1426-b726-4da0-9c20-39e3a7e7efe0 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:00 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-422d1426-b726-4da0-9c20-39e3a7e7efe0 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:00 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-422d1426-b726-4da0-9c20-39e3a7e7efe0 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-422d1426-b726-4da0-9c20-39e3a7e7efe0 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1084 microversion: 2.1 time: 0.071552 Apr 12 06:23:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:00 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1084 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:02 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02e22a24944fdf952fd302b608a293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e95975f26a4677b628411ddb18c68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-b21e1cec-b75b-4bc6-b3db-1ab6e513719e tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 200 len: 1546 microversion: 2.1 time: 0.180444 Apr 12 06:23:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:02 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d4210a3e-b87c-4663-b784-3f9acee7a3c7 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 200 len: 1626 microversion: 2.49 time: 0.303910 Apr 12 06:23:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 38/112] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:23:03 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 1626 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:23:03 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Creating event network-changed:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:23:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044184 Apr 12 06:23:03 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:07 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f053ed1c99c0480c9d1b0bc466e49e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56a846b9e34aada0c72df46d47b77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:07 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9ef5cb1b-4be5-4590-acc6-eceedb2623d7 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6" status: 200 len: 1525 microversion: 2.1 time: 0.170641 Apr 12 06:23:07 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:07 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6 => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Creating event network-vif-plugged:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048782 Apr 12 06:23:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "48b06cf1-3d27-423d-a0fb-952c396a727c"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:11 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=9 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Creating event network-vif-plugged:48b06cf1-3d27-423d-a0fb-952c396a727c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043324 Apr 12 06:23:11 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:11 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-plugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Creating event network-vif-plugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:23:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Apr 12 06:23:11 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Creating event network-vif-plugged:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303373 Apr 12 06:23:12 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "48b06cf1-3d27-423d-a0fb-952c396a727c"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Creating event network-vif-plugged:48b06cf1-3d27-423d-a0fb-952c396a727c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Creating event network-vif-plugged:1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Creating event network-vif-plugged:1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Creating event network-vif-plugged:1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.034742 Apr 12 06:23:13 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:13 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-plugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "f984771f-43c1-4565-8e7f-34d142b19801"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "f984771f-43c1-4565-8e7f-34d142b19801"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "6ee43811-1303-4a84-8bd4-0de882daac34"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "6ee43811-1303-4a84-8bd4-0de882daac34"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Creating event network-vif-plugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:23:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Creating event network-vif-plugged:f984771f-43c1-4565-8e7f-34d142b19801 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Creating event network-vif-plugged:f984771f-43c1-4565-8e7f-34d142b19801 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Creating event network-vif-plugged:6ee43811-1303-4a84-8bd4-0de882daac34 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Creating event network-vif-plugged:6ee43811-1303-4a84-8bd4-0de882daac34 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.040405 Apr 12 06:23:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 40/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:15 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "22b7b070-9ef1-402f-8cbc-50684b0dad1c"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "22b7b070-9ef1-402f-8cbc-50684b0dad1c"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Creating event network-vif-plugged:1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Creating event network-vif-plugged:22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Creating event network-vif-plugged:22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:23:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032031 Apr 12 06:23:15 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-696456814", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "c388c547-af8b-4a08-a268-43eb751fa0c1"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] validate_networks() for [('c388c547-af8b-4a08-a268-43eb751fa0c1', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Getting quotas for project fbca90b5b5fb49ca857aa4e215a99e37. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Getting quotas for user e761442395d14d7f82216e3d4174e43a and project fbca90b5b5fb49ca857aa4e215a99e37. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:23:27 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:23:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.570609 Apr 12 06:23:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 41/122] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:23:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:23:28 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=5 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:28 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=20 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ffd2989a-a8b5-4f07-8f6f-9347d136f012 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:28 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ffd2989a-a8b5-4f07-8f6f-9347d136f012 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:28 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-ffd2989a-a8b5-4f07-8f6f-9347d136f012 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ffd2989a-a8b5-4f07-8f6f-9347d136f012 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 200 len: 1210 microversion: 2.1 time: 0.067633 Apr 12 06:23:28 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 41/123] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:28 2023] GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 1210 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:30 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=5 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:30 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=14 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a24ff32-6994-4754-be34-7664bbe21d16", "tag": "de80dcd5-e1e5-485d-ab7f-e595447273da"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Creating event network-changed:de80dcd5-e1e5-485d-ab7f-e595447273da for instance 2a24ff32-6994-4754-be34-7664bbe21d16 on user Apr 12 06:23:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048740 Apr 12 06:23:30 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff32-6994-4754-be34-7664bbe21d16", "name": "network-vif-plugged", "status": "completed", "tag": "de80dcd5-e1e5-485d-ab7f-e595447273da"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Creating event network-vif-plugged:de80dcd5-e1e5-485d-ab7f-e595447273da for instance 2a24ff32-6994-4754-be34-7664bbe21d16 on user Apr 12 06:23:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028000 Apr 12 06:23:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:32 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ff21c922-4111-4bd2-b1b7-9c2b1cdbb808 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38" status: 200 len: 1539 microversion: 2.1 time: 0.156287 Apr 12 06:23:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 42/126] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:32 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-556edaf6-997a-4436-987f-514c99f6709f tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 200 len: 2821 microversion: 2.42 time: 0.210420 Apr 12 06:23:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:23:33 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 2821 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:23:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff32-6994-4754-be34-7664bbe21d16", "name": "network-vif-plugged", "status": "completed", "tag": "de80dcd5-e1e5-485d-ab7f-e595447273da"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Creating event network-vif-plugged:de80dcd5-e1e5-485d-ab7f-e595447273da for instance 2a24ff32-6994-4754-be34-7664bbe21d16 on user Apr 12 06:23:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030176 Apr 12 06:23:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-aa67dc2b-7362-4270-8cc6-45a32e3f6ce3 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.148268 Apr 12 06:23:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 43/129] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:23:38 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-interface => generated 283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Creating event network-changed:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:23:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034027 Apr 12 06:23:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-738ccef8-90ed-479b-832d-a1caef553798 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/ips" status: 200 len: 105 microversion: 2.1 time: 0.112948 Apr 12 06:23:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 44/131] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:23:39 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/ips => generated 105 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc6abfcd-2056-4ae6-a4d3-a20b324333a0"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "POST /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388444 Apr 12 06:23:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 44/132] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:23:40 2023] POST /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34023a39-bbf4-4afb-948b-0bff9f563bb8"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413159 Apr 12 06:23:41 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 45/133] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:23:41 2023] POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7a7a8ef0-acf7-4383-a103-490e97dc4e25 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103707 Apr 12 06:23:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 45/134] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:23:43 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Creating event network-changed:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:23:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061458 Apr 12 06:23:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:45 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-9470c64e-cad1-4fb3-890c-8837cc8560bd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1540 microversion: 2.1 time: 0.261573 Apr 12 06:23:45 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 46/136] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:44 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1540 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:45 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-5051e0ce-17bd-469f-baab-9882e615adff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1540 microversion: 2.1 time: 0.440844 Apr 12 06:23:45 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 46/137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:45 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1540 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:48 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:23:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 204 len: 0 microversion: 2.1 time: 0.139418 Apr 12 06:23:48 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:23:48 2023] DELETE /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:48 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e2b19e9dd4d578a38e1ddec680b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e474b11e55eb45ff91f140aae7e2981d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:49 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a3db23d6-3e1a-43b8-a814-8cdfaa366316 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 200 len: 1540 microversion: 2.1 time: 0.305556 Apr 12 06:23:49 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 47/139] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:48 2023] GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 1540 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:49 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149703ba-0e5a-46f3-b988-d864de1c2137", "name": "network-vif-unplugged", "status": "completed", "tag": "9c356d39-d585-49ef-82de-d123a1d5e0d6"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Creating event network-vif-unplugged:9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance 149703ba-0e5a-46f3-b988-d864de1c2137 on user Apr 12 06:23:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053151 Apr 12 06:23:49 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 47/140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:49 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Going to try to stop instance {{(pid=62042) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 06:23:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action" status: 202 len: 0 microversion: 2.1 time: 0.110078 Apr 12 06:23:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 47/141] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:23:49 2023] POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:49 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:50 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-19a01155-2667-452a-9566-f867b670aafe tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1711 microversion: 2.1 time: 0.184610 Apr 12 06:23:50 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:49 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1711 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:50 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-unplugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:50 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Creating event network-vif-unplugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:23:50 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043321 Apr 12 06:23:50 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 48/143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:50 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:23:50 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-b979931e-f37f-48ed-a9c7-388a8aa98964 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1434 microversion: 2.1 time: 0.204421 Apr 12 06:23:50 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:23:50 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1434 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:23:51 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149703ba-0e5a-46f3-b988-d864de1c2137", "name": "network-vif-plugged", "status": "completed", "tag": "9c356d39-d585-49ef-82de-d123a1d5e0d6"}, {"server_uuid": "149703ba-0e5a-46f3-b988-d864de1c2137", "name": "network-vif-deleted", "tag": "9c356d39-d585-49ef-82de-d123a1d5e0d6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Creating event network-vif-plugged:9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance 149703ba-0e5a-46f3-b988-d864de1c2137 on user Apr 12 06:23:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Creating event network-vif-deleted:9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance 149703ba-0e5a-46f3-b988-d864de1c2137 on user Apr 12 06:23:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031825 Apr 12 06:23:51 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:23:52 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:23:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:23:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:23:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:23:52 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:23:52 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042568 Apr 12 06:23:52 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 49/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3fe8d8ca-cf24-4ab9-9964-d57e007ed15b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.094336 Apr 12 06:24:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:24:02 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-interface => generated 282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=16 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-01310232-b8c0-42ce-9058-79075200e86f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.137981 Apr 12 06:24:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 50/148] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:24:03 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-interface => generated 282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:24:03 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:03 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=26 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:03 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:04 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Creating event network-changed:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:24:04 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405668 Apr 12 06:24:04 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 50/149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:04 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:04 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:04 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:04 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:04 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Creating event network-changed:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:04 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033172 Apr 12 06:24:04 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:04 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:04 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0745adbe-af03-4287-962e-05a1efede3da tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 200 len: 1626 microversion: 2.49 time: 0.255506 Apr 12 06:24:04 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 51/151] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:24:04 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 1626 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "tag": "nic-tag"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e858dd17-43f2-4bb6-9d13-6f151b01bd2d"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265914 Apr 12 06:24:05 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 51/152] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:24:05 2023] POST /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:06 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "tag": "6cf08234-4591-4998-8bf0-c2b02614a969"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:06 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Creating event network-changed:6cf08234-4591-4998-8bf0-c2b02614a969 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:06 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037827 Apr 12 06:24:06 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:07 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-55ff694a-35d3-498d-9321-0c1182483c2f tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.161502 Apr 12 06:24:07 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 52/154] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:24:07 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-plugged", "status": "completed", "tag": "6cf08234-4591-4998-8bf0-c2b02614a969"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Creating event network-vif-plugged:6cf08234-4591-4998-8bf0-c2b02614a969 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070879 Apr 12 06:24:08 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 53/155] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-interface" status: 200 len: 281 microversion: 2.49 time: 3.866876 Apr 12 06:24:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 51/156] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 06:24:04 2023] POST /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-interface => generated 281 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2470870-a46d-44c2-98dc-448e98ab0866", "tag": "volume-tag"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1872667c-83a2-4de7-a347-cc3fd70bf901"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.354846 Apr 12 06:24:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 53/157] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 06:24:08 2023] POST /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:24:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "POST /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303927 Apr 12 06:24:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 54/158] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:24:08 2023] POST /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-plugged", "status": "completed", "tag": "6cf08234-4591-4998-8bf0-c2b02614a969"}, {"name": "network-changed", "server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Creating event network-vif-plugged:6cf08234-4591-4998-8bf0-c2b02614a969 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Creating event network-changed:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:24:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033340 Apr 12 06:24:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 52/159] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:10 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e9f11db7-5d94-4e8f-82d1-182b8e19b65b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054210 Apr 12 06:24:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:13 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:13 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'services' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:24:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments/e858dd17-43f2-4bb6-9d13-6f151b01bd2d" status: 202 len: 0 microversion: 2.1 time: 0.274346 Apr 12 06:24:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:24:13 2023] DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments/e858dd17-43f2-4bb6-9d13-6f151b01bd2d => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:16 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'services' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:24:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-volume_attachments/d2470870-a46d-44c2-98dc-448e98ab0866" status: 202 len: 0 microversion: 2.49 time: 0.260645 Apr 12 06:24:16 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 53/162] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 06:24:16 2023] DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-volume_attachments/d2470870-a46d-44c2-98dc-448e98ab0866 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a0819b26-7af7-426a-8242-84954c0851f5"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-818e5a8a-46ee-44df-8969-fe3a348db9ab tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046611 Apr 12 06:24:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 56/163] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:17 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7eeac571-d0f6-4465-98b5-7397a4cc3a7b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048797 Apr 12 06:24:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:17 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:18 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:24:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments/1872667c-83a2-4de7-a347-cc3fd70bf901" status: 202 len: 0 microversion: 2.1 time: 0.586538 Apr 12 06:24:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 55/165] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 06:24:17 2023] PUT /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments/1872667c-83a2-4de7-a347-cc3fd70bf901 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:24:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 204 len: 0 microversion: 2.1 time: 0.129229 Apr 12 06:24:18 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 57/166] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:24:17 2023] DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:18 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de02e22a24944fdf952fd302b608a293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e95975f26a4677b628411ddb18c68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-97345f6f-f78b-4633-9715-64587425a148 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 200 len: 1670 microversion: 2.1 time: 0.248352 Apr 12 06:24:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:18 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:18 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:18 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "name": "network-vif-unplugged", "status": "completed", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-01e2bce9-fd97-44bd-b0ea-7da23ced71d3 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 200 len: 1494 microversion: 2.1 time: 0.207714 Apr 12 06:24:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:18 2023] GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 1494 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Creating event network-vif-unplugged:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:24:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046718 Apr 12 06:24:18 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 58/169] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-interface/6cf08234-4591-4998-8bf0-c2b02614a969" status: 202 len: 0 microversion: 2.49 time: 0.168735 Apr 12 06:24:19 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 56/170] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 06:24:19 2023] DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-interface/6cf08234-4591-4998-8bf0-c2b02614a969 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0d110f01-b6dd-440f-8aaa-409420ae7344 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-instance-actions/req-f5c53a01-d337-489b-93d2-07735f90f1f1" status: 200 len: 474 microversion: 2.49 time: 0.211700 Apr 12 06:24:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 57/171] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 06:24:19 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-instance-actions/req-f5c53a01-d337-489b-93d2-07735f90f1f1 => generated 474 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:24:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-deleted", "tag": "6cf08234-4591-4998-8bf0-c2b02614a969"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Creating event network-vif-deleted:6cf08234-4591-4998-8bf0-c2b02614a969 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036712 Apr 12 06:24:20 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 59/172] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:20 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "name": "network-vif-deleted", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] Creating event network-vif-deleted:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:24:20 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb450dca-84ef-47c4-9038-9269a661bb12", "name": "network-vif-plugged", "status": "completed", "tag": "89d27424-e166-42ad-b7e2-1b1a3101f207"}, {"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-unplugged", "status": "completed", "tag": "6cf08234-4591-4998-8bf0-c2b02614a969"}, {"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-plugged", "status": "completed", "tag": "6cf08234-4591-4998-8bf0-c2b02614a969"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087621 Apr 12 06:24:20 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Creating event network-vif-plugged:89d27424-e166-42ad-b7e2-1b1a3101f207 for instance eb450dca-84ef-47c4-9038-9269a661bb12 on user Apr 12 06:24:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Creating event network-vif-unplugged:6cf08234-4591-4998-8bf0-c2b02614a969 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Creating event network-vif-plugged:6cf08234-4591-4998-8bf0-c2b02614a969 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:24:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034970 Apr 12 06:24:20 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 58/174] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:20 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-24a39904-25d9-483b-811c-f5cd422ca713 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Apr 12 06:24:30 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 60/175] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:30 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2f803da9-1752-4487-9c19-19b1e0f69559 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059864 Apr 12 06:24:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:30 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1872667c-83a2-4de7-a347-cc3fd70bf901"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:30 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments/a0819b26-7af7-426a-8242-84954c0851f5" status: 202 len: 0 microversion: 2.1 time: 0.271096 Apr 12 06:24:30 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 59/177] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 06:24:30 2023] PUT /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments/a0819b26-7af7-426a-8242-84954c0851f5 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-050caab5-35ff-48e3-a51c-5186e3fcd4c6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38" status: 200 len: 1539 microversion: 2.1 time: 0.147787 Apr 12 06:24:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 61/178] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:33 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2ff107f2-cf49-4b69-ab80-5d0a5e041082 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.147462 Apr 12 06:24:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:24:34 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/os-interface => generated 1829 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:24:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:34 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=23 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:34 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Creating event network-changed:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:24:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037364 Apr 12 06:24:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b336ad6-910c-4dd4-8ef4-c16d440e9881"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:34 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=23 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:24:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320281 Apr 12 06:24:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 62/181] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:24:34 2023] POST /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Creating event network-changed:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046625 Apr 12 06:24:35 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:35 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3ed1ae83-6bbf-4e75-96ff-aba3df09ffc6 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 200 len: 2821 microversion: 2.42 time: 0.435188 Apr 12 06:24:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:24:35 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 2821 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-bf4fe627-60eb-40e1-83c7-1e2a63173397 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.126076 Apr 12 06:24:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 63/184] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:24:35 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/os-interface => generated 1829 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:24:36 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4084b954-b29a-44bd-b7d9-88657a131215 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1658 microversion: 2.1 time: 0.260763 Apr 12 06:24:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:35 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1658 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:36 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c5d67d17-e86c-445f-a9fa-8f72dc574234 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1658 microversion: 2.1 time: 0.154604 Apr 12 06:24:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:36 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:24:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 204 len: 0 microversion: 2.42 time: 0.157785 Apr 12 06:24:37 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 64/187] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:24:36 2023] DELETE /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-607ec588-288a-42ee-8a01-52786c5ba977 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 200 len: 2946 microversion: 2.42 time: 0.441279 Apr 12 06:24:37 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:24:37 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 2946 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:24:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "48b06cf1-3d27-423d-a0fb-952c396a727c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Creating event network-vif-unplugged:48b06cf1-3d27-423d-a0fb-952c396a727c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071200 Apr 12 06:24:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 63/189] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:37 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Creating event network-vif-unplugged:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077921 Apr 12 06:24:37 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 65/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "f984771f-43c1-4565-8e7f-34d142b19801"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Creating event network-vif-unplugged:f984771f-43c1-4565-8e7f-34d142b19801 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048907 Apr 12 06:24:37 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] HTTP exception thrown: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Request method failure captured: Apr 12 06:24:39 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 HTTP/1.1 Apr 12 06:24:39 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:24:39 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:24:39 user devstack@n-api.service[62042]: Connection: close Apr 12 06:24:39 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:24:39 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:24:39 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:24:39 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:24:39 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk36LCasA8Wj4m2ZIW0PxI8ImK7U3SOjg2wiCXNedVdXjVeSO8Pz2mquRspLEm_U2eHsbBZFpU9D46O2otiRNzVzV-AvohF-vGNbxC_DpUAu2rEWsEIH0dw_nOBY9_ecFRCrPdOBSGUxzwmXiLB1GTfF8JFCxMAbzSNxPu_cVxXG87I Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Project-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Project-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}] Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Tenant: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Tenant-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:39 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:39 user devstack@n-api.service[62042]: X-User: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:39 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:24:39 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:24:39 user devstack@n-api.service[62042]: X-User-Id: ee2e2b19e9dd4d578a38e1ddec680b5d Apr 12 06:24:39 user devstack@n-api.service[62042]: X-User-Name: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:39 user devstack@n-api.service[62042]: method: > Apr 12 06:24:39 user devstack@n-api.service[62042]: exception: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62042]: action_args: {'id': '149703ba-0e5a-46f3-b988-d864de1c2137'} Apr 12 06:24:39 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Returning 404 to user: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:24:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-abd878db-8cad-4520-858a-ddd4bfe3cc20 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 404 len: 111 microversion: 2.1 time: 0.094522 Apr 12 06:24:39 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:39 2023] GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] HTTP exception thrown: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Request method failure captured: Apr 12 06:24:39 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137/os-volume_attachments HTTP/1.1 Apr 12 06:24:39 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:24:39 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:24:39 user devstack@n-api.service[62040]: Connection: close Apr 12 06:24:39 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:24:39 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:24:39 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:24:39 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:24:39 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk36LCasA8Wj4m2ZIW0PxI8ImK7U3SOjg2wiCXNedVdXjVeSO8Pz2mquRspLEm_U2eHsbBZFpU9D46O2otiRNzVzV-AvohF-vGNbxC_DpUAu2rEWsEIH0dw_nOBY9_ecFRCrPdOBSGUxzwmXiLB1GTfF8JFCxMAbzSNxPu_cVxXG87I Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Project-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Project-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}] Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Tenant: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Tenant-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:39 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:39 user devstack@n-api.service[62040]: X-User: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:39 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:24:39 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:24:39 user devstack@n-api.service[62040]: X-User-Id: ee2e2b19e9dd4d578a38e1ddec680b5d Apr 12 06:24:39 user devstack@n-api.service[62040]: X-User-Name: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:39 user devstack@n-api.service[62040]: method: > Apr 12 06:24:39 user devstack@n-api.service[62040]: exception: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62040]: action_args: {'server_id': '149703ba-0e5a-46f3-b988-d864de1c2137'} Apr 12 06:24:39 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:39 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Returning 404 to user: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:24:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4d287b25-8e8a-4de2-9b5d-cf59362487a7 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077732 Apr 12 06:24:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:39 2023] GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:24:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "48b06cf1-3d27-423d-a0fb-952c396a727c"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Creating event network-vif-plugged:48b06cf1-3d27-423d-a0fb-952c396a727c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Creating event network-vif-unplugged:1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Creating event network-vif-plugged:1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Creating event network-vif-unplugged:1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Creating event network-vif-plugged:1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.057884 Apr 12 06:24:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 64/194] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Creating event network-vif-plugged:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051565 Apr 12 06:24:39 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 65/195] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:40 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-227266cb-bd8c-4d4b-8087-5eaa8f08ef5a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1688 microversion: 2.1 time: 0.224041 Apr 12 06:24:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:40 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "f984771f-43c1-4565-8e7f-34d142b19801"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "6ee43811-1303-4a84-8bd4-0de882daac34"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "6ee43811-1303-4a84-8bd4-0de882daac34"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Creating event network-vif-plugged:f984771f-43c1-4565-8e7f-34d142b19801 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Creating event network-vif-unplugged:6ee43811-1303-4a84-8bd4-0de882daac34 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Creating event network-vif-plugged:6ee43811-1303-4a84-8bd4-0de882daac34 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032696 Apr 12 06:24:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 65/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:40 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:24:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-unplugged", "status": "completed", "tag": "22b7b070-9ef1-402f-8cbc-50684b0dad1c"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-plugged", "status": "completed", "tag": "22b7b070-9ef1-402f-8cbc-50684b0dad1c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Creating event network-vif-unplugged:22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Creating event network-vif-plugged:22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035685 Apr 12 06:24:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 66/198] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6be91d81-6707-44cc-9a78-f9ae44de1ee2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Apr 12 06:24:42 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 68/199] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:42 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-db863902-567a-416a-acf2-a41e73ebb346 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Apr 12 06:24:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:42 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'services' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:24:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments/1872667c-83a2-4de7-a347-cc3fd70bf901" status: 202 len: 0 microversion: 2.1 time: 0.291708 Apr 12 06:24:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:24:42 2023] DELETE /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments/1872667c-83a2-4de7-a347-cc3fd70bf901 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-015f5428-8a57-49fd-979f-8881f9efd9f3 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Apr 12 06:24:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 69/202] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:42 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-deleted", "tag": "55fc6a3a-a62f-406f-9583-f4168544b133"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] Creating event network-vif-deleted:55fc6a3a-a62f-406f-9583-f4168544b133 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Apr 12 06:24:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 67/203] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] HTTP exception thrown: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Request method failure captured: Apr 12 06:24:43 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 HTTP/1.1 Apr 12 06:24:43 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:24:43 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:24:43 user devstack@n-api.service[62042]: Connection: close Apr 12 06:24:43 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:24:43 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:24:43 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:24:43 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:24:43 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk36LCasA8Wj4m2ZIW0PxI8ImK7U3SOjg2wiCXNedVdXjVeSO8Pz2mquRspLEm_U2eHsbBZFpU9D46O2otiRNzVzV-AvohF-vGNbxC_DpUAu2rEWsEIH0dw_nOBY9_ecFRCrPdOBSGUxzwmXiLB1GTfF8JFCxMAbzSNxPu_cVxXG87I Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Project-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Project-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}] Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Tenant: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Tenant-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:43 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:43 user devstack@n-api.service[62042]: X-User: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:43 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:24:43 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:24:43 user devstack@n-api.service[62042]: X-User-Id: ee2e2b19e9dd4d578a38e1ddec680b5d Apr 12 06:24:43 user devstack@n-api.service[62042]: X-User-Name: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:43 user devstack@n-api.service[62042]: method: > Apr 12 06:24:43 user devstack@n-api.service[62042]: exception: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62042]: action_args: {'id': '149703ba-0e5a-46f3-b988-d864de1c2137'} Apr 12 06:24:43 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Returning 404 to user: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:24:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0a4b6ba8-f4bf-4a56-9dbd-de91779cc641 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 404 len: 111 microversion: 2.1 time: 0.043894 Apr 12 06:24:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:24:43 2023] DELETE /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] HTTP exception thrown: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Request method failure captured: Apr 12 06:24:43 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 HTTP/1.1 Apr 12 06:24:43 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:24:43 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:24:43 user devstack@n-api.service[62040]: Connection: close Apr 12 06:24:43 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:24:43 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:24:43 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:24:43 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:24:43 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk36LCasA8Wj4m2ZIW0PxI8ImK7U3SOjg2wiCXNedVdXjVeSO8Pz2mquRspLEm_U2eHsbBZFpU9D46O2otiRNzVzV-AvohF-vGNbxC_DpUAu2rEWsEIH0dw_nOBY9_ecFRCrPdOBSGUxzwmXiLB1GTfF8JFCxMAbzSNxPu_cVxXG87I Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Project-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Project-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e474b11e55eb45ff91f140aae7e2981d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e474b11e55eb45ff91f140aae7e2981d"}]}] Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Tenant: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Tenant-Id: e474b11e55eb45ff91f140aae7e2981d Apr 12 06:24:43 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-DeleteServersTestJSON-1256853091 Apr 12 06:24:43 user devstack@n-api.service[62040]: X-User: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:43 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:24:43 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:24:43 user devstack@n-api.service[62040]: X-User-Id: ee2e2b19e9dd4d578a38e1ddec680b5d Apr 12 06:24:43 user devstack@n-api.service[62040]: X-User-Name: tempest-DeleteServersTestJSON-1256853091-project-member Apr 12 06:24:43 user devstack@n-api.service[62040]: method: > Apr 12 06:24:43 user devstack@n-api.service[62040]: exception: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62040]: action_args: {'id': '149703ba-0e5a-46f3-b988-d864de1c2137'} Apr 12 06:24:43 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. Apr 12 06:24:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:24:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Returning 404 to user: Instance 149703ba-0e5a-46f3-b988-d864de1c2137 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:24:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0a106ac2-c952-412d-a0a0-25d65ef74569 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137" status: 404 len: 111 microversion: 2.1 time: 0.038100 Apr 12 06:24:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 70/205] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:43 2023] GET /compute/v2.1/servers/149703ba-0e5a-46f3-b988-d864de1c2137 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:24:45 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-deleted", "tag": "22b7b070-9ef1-402f-8cbc-50684b0dad1c"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-deleted", "tag": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-deleted", "tag": "f984771f-43c1-4565-8e7f-34d142b19801"}, {"server_uuid": "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b", "name": "network-vif-deleted", "tag": "6ee43811-1303-4a84-8bd4-0de882daac34"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Creating event network-vif-deleted:22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Creating event network-vif-deleted:1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Creating event network-vif-deleted:f984771f-43c1-4565-8e7f-34d142b19801 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] Creating event network-vif-deleted:6ee43811-1303-4a84-8bd4-0de882daac34 for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b on user Apr 12 06:24:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032775 Apr 12 06:24:45 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:46 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'services' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:24:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments/7b336ad6-910c-4dd4-8ef4-c16d440e9881" status: 202 len: 0 microversion: 2.1 time: 0.175698 Apr 12 06:24:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 69/207] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:24:46 2023] DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments/7b336ad6-910c-4dd4-8ef4-c16d440e9881 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7e7ce027-fe78-495e-8472-076d91ee1f3c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051688 Apr 12 06:24:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:24:46 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:51 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8427b1fb-4aad-4f29-ae29-5f04cb686849 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1434 microversion: 2.1 time: 0.290029 Apr 12 06:24:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:50 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1434 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:52 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:52 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:52 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:52 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Creating event network-changed:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:24:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047913 Apr 12 06:24:52 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:53 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'flavor' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:24:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6/action" status: 202 len: 0 microversion: 2.1 time: 0.147761 Apr 12 06:24:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 72/211] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:24:53 2023] POST /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:53 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:24:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-cde87b47-47c8-4f4d-a3fd-00177956c0a5 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1440 microversion: 2.1 time: 0.259682 Apr 12 06:24:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:24:53 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1440 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:24:54 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-unplugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}, {"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-plugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Creating event network-vif-unplugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:24:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Creating event network-vif-plugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:24:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032874 Apr 12 06:24:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 71/213] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:24:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:24:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:24:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:24:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:24:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Creating event network-changed:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:24:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030478 Apr 12 06:24:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 73/214] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=21 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=41 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] HTTP exception thrown: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Request method failure captured: Apr 12 06:25:08 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 HTTP/1.1 Apr 12 06:25:08 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:25:08 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:25:08 user devstack@n-api.service[62041]: Connection: close Apr 12 06:25:08 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:25:08 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:25:08 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:25:08 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:25:08 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk37x9GRTnPULWplROSOG1sBH0WvbOSfKk2cRxmJMPDjlJkLPia9V7i5cptLddLpyKAedZDGeCS8JziRqDROoJDfcv-JP7zE8dcA8gu_04I1_5U9xPks4KAItuHoNnSYbQ_z3cdBFBe01WLTfScuL-ye9v0ms9Wd7AxUBPbsAyd3ps4 Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Project-Id: 94e95975f26a4677b628411ddb18c68c Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e95975f26a4677b628411ddb18c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e95975f26a4677b628411ddb18c68c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e95975f26a4677b628411ddb18c68c"}]}] Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Tenant-Id: 94e95975f26a4677b628411ddb18c68c Apr 12 06:25:08 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:08 user devstack@n-api.service[62041]: X-User: tempest-AttachSCSIVolumeTestJSON-480153316-project-member Apr 12 06:25:08 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:25:08 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:25:08 user devstack@n-api.service[62041]: X-User-Id: de02e22a24944fdf952fd302b608a293 Apr 12 06:25:08 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-480153316-project-member Apr 12 06:25:08 user devstack@n-api.service[62041]: method: > Apr 12 06:25:08 user devstack@n-api.service[62041]: exception: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:08 user devstack@n-api.service[62041]: action_args: {'id': 'eb450dca-84ef-47c4-9038-9269a661bb12'} Apr 12 06:25:08 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Returning 404 to user: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:25:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-77b9e41c-7686-425a-b9e8-838576b7ad8c tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 404 len: 111 microversion: 2.1 time: 0.041704 Apr 12 06:25:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 71/215] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:08 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:25:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=23 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-178da129-83b8-420a-a468-5ae201fa6e1b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '.version_select at 0x7fd24e0eb1c0>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-178da129-83b8-420a-a468-5ae201fa6e1b tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-939806397" status: 202 len: 0 microversion: 2.1 time: 0.030571 Apr 12 06:25:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 72/216] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 06:25:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-939806397 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-80faf234-2999-4d35-95bf-90a6cbb9352d tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-instance-actions/req-f5c53a01-d337-489b-93d2-07735f90f1f1" status: 200 len: 503 microversion: 2.49 time: 0.097118 Apr 12 06:25:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 74/217] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 06:25:09 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-instance-actions/req-f5c53a01-d337-489b-93d2-07735f90f1f1 => generated 503 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-94727a74-81d2-458c-b7a3-2226fa622630 tempest-TaggedAttachmentsTest-1738362997 tempest-TaggedAttachmentsTest-1738362997-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-instance-actions/req-f5c53a01-d337-489b-93d2-07735f90f1f1" status: 200 len: 503 microversion: 2.49 time: 0.094961 Apr 12 06:25:09 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 72/218] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 06:25:09 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-instance-actions/req-f5c53a01-d337-489b-93d2-07735f90f1f1 => generated 503 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-01289c13-7e7c-4afa-9a21-fc66779e1b1c tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.048606 Apr 12 06:25:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 73/219] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 06:25:09 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:09 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:25:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 204 len: 0 microversion: 2.49 time: 0.124849 Apr 12 06:25:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 75/220] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:25:09 2023] DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:10 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-70510367-9b9b-4f80-8bcf-c87c5f949755 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 200 len: 1751 microversion: 2.49 time: 0.274177 Apr 12 06:25:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 73/221] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:25:10 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 1751 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:25:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-unplugged", "status": "completed", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Creating event network-vif-unplugged:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:25:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059975 Apr 12 06:25:10 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:11 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] HTTP exception thrown: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Request method failure captured: Apr 12 06:25:11 user devstack@n-api.service[62040]: request: DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 HTTP/1.1 Apr 12 06:25:11 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:25:11 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:25:11 user devstack@n-api.service[62040]: Connection: close Apr 12 06:25:11 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:25:11 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:25:11 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:25:11 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:25:11 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk37x9GRTnPULWplROSOG1sBH0WvbOSfKk2cRxmJMPDjlJkLPia9V7i5cptLddLpyKAedZDGeCS8JziRqDROoJDfcv-JP7zE8dcA8gu_04I1_5U9xPks4KAItuHoNnSYbQ_z3cdBFBe01WLTfScuL-ye9v0ms9Wd7AxUBPbsAyd3ps4 Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Project-Id: 94e95975f26a4677b628411ddb18c68c Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e95975f26a4677b628411ddb18c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e95975f26a4677b628411ddb18c68c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e95975f26a4677b628411ddb18c68c"}]}] Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Tenant-Id: 94e95975f26a4677b628411ddb18c68c Apr 12 06:25:11 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:11 user devstack@n-api.service[62040]: X-User: tempest-AttachSCSIVolumeTestJSON-480153316-project-member Apr 12 06:25:11 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:25:11 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:25:11 user devstack@n-api.service[62040]: X-User-Id: de02e22a24944fdf952fd302b608a293 Apr 12 06:25:11 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-480153316-project-member Apr 12 06:25:11 user devstack@n-api.service[62040]: method: > Apr 12 06:25:11 user devstack@n-api.service[62040]: exception: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62040]: action_args: {'id': 'eb450dca-84ef-47c4-9038-9269a661bb12'} Apr 12 06:25:11 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Returning 404 to user: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:25:11 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-afa225f0-1dae-45e0-8dd3-2e31a225067f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 404 len: 111 microversion: 2.1 time: 0.028850 Apr 12 06:25:11 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 76/223] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:25:11 2023] DELETE /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] HTTP exception thrown: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Request method failure captured: Apr 12 06:25:11 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 HTTP/1.1 Apr 12 06:25:11 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:25:11 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:25:11 user devstack@n-api.service[62041]: Connection: close Apr 12 06:25:11 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:25:11 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:25:11 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:25:11 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:25:11 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk37x9GRTnPULWplROSOG1sBH0WvbOSfKk2cRxmJMPDjlJkLPia9V7i5cptLddLpyKAedZDGeCS8JziRqDROoJDfcv-JP7zE8dcA8gu_04I1_5U9xPks4KAItuHoNnSYbQ_z3cdBFBe01WLTfScuL-ye9v0ms9Wd7AxUBPbsAyd3ps4 Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Project-Id: 94e95975f26a4677b628411ddb18c68c Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e95975f26a4677b628411ddb18c68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94e95975f26a4677b628411ddb18c68c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94e95975f26a4677b628411ddb18c68c"}]}] Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Tenant-Id: 94e95975f26a4677b628411ddb18c68c Apr 12 06:25:11 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-480153316 Apr 12 06:25:11 user devstack@n-api.service[62041]: X-User: tempest-AttachSCSIVolumeTestJSON-480153316-project-member Apr 12 06:25:11 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:25:11 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:25:11 user devstack@n-api.service[62041]: X-User-Id: de02e22a24944fdf952fd302b608a293 Apr 12 06:25:11 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-480153316-project-member Apr 12 06:25:11 user devstack@n-api.service[62041]: method: > Apr 12 06:25:11 user devstack@n-api.service[62041]: exception: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62041]: action_args: {'id': 'eb450dca-84ef-47c4-9038-9269a661bb12'} Apr 12 06:25:11 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:11 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:25:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:25:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:25:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:25:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. Apr 12 06:25:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Returning 404 to user: Instance eb450dca-84ef-47c4-9038-9269a661bb12 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:25:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4cf18434-71dd-4e89-afe9-21e38b087699 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12" status: 404 len: 111 microversion: 2.1 time: 0.031815 Apr 12 06:25:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:11 2023] GET /compute/v2.1/servers/eb450dca-84ef-47c4-9038-9269a661bb12 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:25:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-plugged", "status": "completed", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}, {"server_uuid": "1c02afd2-428b-49c9-a5e9-016fdeab1046", "name": "network-vif-deleted", "tag": "e215c62b-ca21-474c-bb78-e65c3d3a6d23"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Creating event network-vif-plugged:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:25:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Creating event network-vif-deleted:e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 on user Apr 12 06:25:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069258 Apr 12 06:25:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 75/225] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d3391e01-cc3f-41f3-89e6-9b97c1f6d867 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Action: 'create', calling method: .version_select at 0x7fd24dee25f0>, body: {"keypair": {"name": "tempest-keypair-1769866146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:13 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-d3391e01-cc3f-41f3-89e6-9b97c1f6d867 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting quotas for project 6b22588bca2c46f09b19d28bcf76db06. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:25:13 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-d3391e01-cc3f-41f3-89e6-9b97c1f6d867 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting quotas for user 38d195bbdaf94ac9bfdba8f76157a10f and project 6b22588bca2c46f09b19d28bcf76db06. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:25:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d3391e01-cc3f-41f3-89e6-9b97c1f6d867 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.046095 Apr 12 06:25:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 77/226] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 06:25:13 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:25:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1994861012", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "487458d7-109b-469f-914b-1d6d01919059"}, {"port": "44948ebb-503b-4166-936e-6c4101625453", "tag": "port-1"}, {"port": "350ec490-a274-4fe0-a88d-4d558e0d4337", "tag": "port-2"}, {"uuid": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "tag": "net-1"}, {"uuid": "09a9d52e-7141-4591-a5a9-d93a1668c0dc"}, {"uuid": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "43ddfeaf-9407-49e8-abb1-f5c9d23dab3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8c9b01f5-884d-4f16-b344-ea6facab9090", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6c75bc08-5a02-4b60-9201-616a5a4f1d88", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1825146932"}], "key_name": "tempest-keypair-1769866146", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:15 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] validate_networks() for [('487458d7-109b-469f-914b-1d6d01919059', None, None, None, None, None), (None, None, '44948ebb-503b-4166-936e-6c4101625453', None, None, None), (None, None, '350ec490-a274-4fe0-a88d-4d558e0d4337', None, None, None), ('09a9d52e-7141-4591-a5a9-d93a1668c0dc', None, None, None, None, None), ('09a9d52e-7141-4591-a5a9-d93a1668c0dc', None, None, None, None, None), ('f7d32909-b6bd-4374-a598-a86d2fca37bc', '10.2.2.100', None, None, None, None), ('f7d32909-b6bd-4374-a598-a86d2fca37bc', '10.2.2.200', None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting quotas for project 6b22588bca2c46f09b19d28bcf76db06. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting quotas for user 38d195bbdaf94ac9bfdba8f76157a10f and project 6b22588bca2c46f09b19d28bcf76db06. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:25:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='43ddfeaf-9407-49e8-abb1-f5c9d23dab3f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8c9b01f5-884d-4f16-b344-ea6facab9090',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c75bc08-5a02-4b60-9201-616a5a4f1d88',volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:25:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.694070 Apr 12 06:25:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 75/227] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 06:25:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:25:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c40fd6be-5c2f-43c8-b63b-7891585d61cd tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c40fd6be-5c2f-43c8-b63b-7891585d61cd tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:17 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c40fd6be-5c2f-43c8-b63b-7891585d61cd tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:17 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c40fd6be-5c2f-43c8-b63b-7891585d61cd tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:17 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c40fd6be-5c2f-43c8-b63b-7891585d61cd tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c40fd6be-5c2f-43c8-b63b-7891585d61cd tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 200 len: 1280 microversion: 2.32 time: 0.078512 Apr 12 06:25:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 76/228] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:25:17 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:18 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:25:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 204 len: 0 microversion: 2.1 time: 0.113872 Apr 12 06:25:18 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:25:18 2023] DELETE /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff32-6994-4754-be34-7664bbe21d16", "name": "network-vif-unplugged", "status": "completed", "tag": "de80dcd5-e1e5-485d-ab7f-e595447273da"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:18 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ea370b78-d104-489b-aa84-d0e98f93900f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 200 len: 1500 microversion: 2.1 time: 0.301719 Apr 12 06:25:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:18 2023] GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Creating event network-vif-unplugged:de80dcd5-e1e5-485d-ab7f-e595447273da for instance 2a24ff32-6994-4754-be34-7664bbe21d16 on user Apr 12 06:25:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041191 Apr 12 06:25:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 77/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff32-6994-4754-be34-7664bbe21d16", "name": "network-vif-deleted", "tag": "de80dcd5-e1e5-485d-ab7f-e595447273da"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] Creating event network-vif-deleted:de80dcd5-e1e5-485d-ab7f-e595447273da for instance 2a24ff32-6994-4754-be34-7664bbe21d16 on user Apr 12 06:25:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034552 Apr 12 06:25:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:20 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff32-6994-4754-be34-7664bbe21d16", "name": "network-vif-plugged", "status": "completed", "tag": "de80dcd5-e1e5-485d-ab7f-e595447273da"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Creating event network-vif-plugged:de80dcd5-e1e5-485d-ab7f-e595447273da for instance 2a24ff32-6994-4754-be34-7664bbe21d16 on user Apr 12 06:25:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Apr 12 06:25:20 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 77/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Creating event network-changed:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043540 Apr 12 06:25:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 78/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:25 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:25 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "44948ebb-503b-4166-936e-6c4101625453"}, {"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "350ec490-a274-4fe0-a88d-4d558e0d4337"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Creating event network-changed:44948ebb-503b-4166-936e-6c4101625453 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Creating event network-changed:350ec490-a274-4fe0-a88d-4d558e0d4337 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038620 Apr 12 06:25:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 80/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] HTTP exception thrown: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Request method failure captured: Apr 12 06:25:27 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b HTTP/1.1 Apr 12 06:25:27 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:25:27 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:25:27 user devstack@n-api.service[62041]: Connection: close Apr 12 06:25:27 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:25:27 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:25:27 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:25:27 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:25:27 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk31UJIwxNFIQiGCJ2oTYHfckVDPhiaLeO0KfqJh51MXiRlIJ2XMN7qycLpH8DBNr_EN3eUWbi-9IbUWFePHOvKh7KGGv1glmpYdKB-ZfidC1pdZlrvodZ5ipl6_lwDjvKuDYEr0buwOZcU9fyH6C7_-rXEHBN6ilvuRJcmWeDpjg7k Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Project-Id: e313922ba234462285d20a4f1f2d88d0 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e313922ba234462285d20a4f1f2d88d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e313922ba234462285d20a4f1f2d88d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e313922ba234462285d20a4f1f2d88d0"}]}] Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Tenant-Id: e313922ba234462285d20a4f1f2d88d0 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-User: tempest-TaggedBootDevicesTest_v242-1197354508-project-member Apr 12 06:25:27 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:25:27 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:25:27 user devstack@n-api.service[62041]: X-User-Id: 977b800fab264446b0492c93b0dc12d3 Apr 12 06:25:27 user devstack@n-api.service[62041]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1197354508-project-member Apr 12 06:25:27 user devstack@n-api.service[62041]: method: > Apr 12 06:25:27 user devstack@n-api.service[62041]: exception: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:27 user devstack@n-api.service[62041]: action_args: {'id': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'} Apr 12 06:25:27 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:25:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Returning 404 to user: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:25:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a0cd327a-dd75-48ca-bb1e-c9bea9ad67bf tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 404 len: 111 microversion: 2.42 time: 0.039897 Apr 12 06:25:27 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 78/236] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:25:27 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:25:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-906cbaed-7976-4bf0-8715-0bdadabceb4e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '.version_select at 0x7fd24ddeae60>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-906cbaed-7976-4bf0-8715-0bdadabceb4e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379416665" status: 204 len: 0 microversion: 2.42 time: 0.024709 Apr 12 06:25:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 79/237] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 06:25:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379416665 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:25:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "36083c4a-f152-4716-a60d-0197287d6ba1"}, {"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Creating event network-changed:36083c4a-f152-4716-a60d-0197287d6ba1 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Creating event network-changed:22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032248 Apr 12 06:25:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 81/238] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "dce0028f-1206-43bb-96c1-d3cbd8f57103"}, {"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "be8e308b-ba21-4e98-95bf-af2ae6446d20"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Creating event network-changed:dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Creating event network-changed:be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041639 Apr 12 06:25:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] HTTP exception thrown: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Request method failure captured: Apr 12 06:25:31 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b HTTP/1.1 Apr 12 06:25:31 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:25:31 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:25:31 user devstack@n-api.service[62042]: Connection: close Apr 12 06:25:31 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:25:31 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:25:31 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:25:31 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:25:31 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk31UJIwxNFIQiGCJ2oTYHfckVDPhiaLeO0KfqJh51MXiRlIJ2XMN7qycLpH8DBNr_EN3eUWbi-9IbUWFePHOvKh7KGGv1glmpYdKB-ZfidC1pdZlrvodZ5ipl6_lwDjvKuDYEr0buwOZcU9fyH6C7_-rXEHBN6ilvuRJcmWeDpjg7k Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Project-Id: e313922ba234462285d20a4f1f2d88d0 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e313922ba234462285d20a4f1f2d88d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e313922ba234462285d20a4f1f2d88d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e313922ba234462285d20a4f1f2d88d0"}]}] Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Tenant-Id: e313922ba234462285d20a4f1f2d88d0 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-User: tempest-TaggedBootDevicesTest_v242-1197354508-project-member Apr 12 06:25:31 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:25:31 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:25:31 user devstack@n-api.service[62042]: X-User-Id: 977b800fab264446b0492c93b0dc12d3 Apr 12 06:25:31 user devstack@n-api.service[62042]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1197354508-project-member Apr 12 06:25:31 user devstack@n-api.service[62042]: method: > Apr 12 06:25:31 user devstack@n-api.service[62042]: exception: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62042]: action_args: {'id': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'} Apr 12 06:25:31 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Returning 404 to user: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:25:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ae9313e2-75d7-48b1-ad69-d2cfdb296b32 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 404 len: 111 microversion: 2.42 time: 0.039602 Apr 12 06:25:31 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 80/240] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:25:31 2023] DELETE /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] HTTP exception thrown: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Request method failure captured: Apr 12 06:25:31 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b HTTP/1.1 Apr 12 06:25:31 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:25:31 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:25:31 user devstack@n-api.service[62040]: Connection: close Apr 12 06:25:31 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:25:31 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:25:31 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:25:31 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:25:31 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk31UJIwxNFIQiGCJ2oTYHfckVDPhiaLeO0KfqJh51MXiRlIJ2XMN7qycLpH8DBNr_EN3eUWbi-9IbUWFePHOvKh7KGGv1glmpYdKB-ZfidC1pdZlrvodZ5ipl6_lwDjvKuDYEr0buwOZcU9fyH6C7_-rXEHBN6ilvuRJcmWeDpjg7k Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Project-Id: e313922ba234462285d20a4f1f2d88d0 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e313922ba234462285d20a4f1f2d88d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e313922ba234462285d20a4f1f2d88d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e313922ba234462285d20a4f1f2d88d0"}]}] Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Tenant-Id: e313922ba234462285d20a4f1f2d88d0 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1197354508 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-User: tempest-TaggedBootDevicesTest_v242-1197354508-project-member Apr 12 06:25:31 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:25:31 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:25:31 user devstack@n-api.service[62040]: X-User-Id: 977b800fab264446b0492c93b0dc12d3 Apr 12 06:25:31 user devstack@n-api.service[62040]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1197354508-project-member Apr 12 06:25:31 user devstack@n-api.service[62040]: method: > Apr 12 06:25:31 user devstack@n-api.service[62040]: exception: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62040]: action_args: {'id': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'} Apr 12 06:25:31 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. Apr 12 06:25:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:25:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Returning 404 to user: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:25:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f9fb9537-a48f-480f-a99b-f1b4897ff290 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" status: 404 len: 111 microversion: 2.42 time: 0.028965 Apr 12 06:25:31 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 82/241] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:25:31 2023] GET /compute/v2.1/servers/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-5de5ecd3-85cb-4d98-bbb3-22bdfafdaf18 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048550 Apr 12 06:25:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 80/242] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:25:33 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:25:33 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6" status: 204 len: 0 microversion: 2.1 time: 0.154107 Apr 12 06:25:33 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 81/243] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:25:33 2023] DELETE /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f053ed1c99c0480c9d1b0bc466e49e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56a846b9e34aada0c72df46d47b77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ea8bc209-704c-438d-a852-27916bb78b95 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6" status: 200 len: 1649 microversion: 2.1 time: 0.209404 Apr 12 06:25:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 83/244] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:33 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6 => generated 1649 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "name": "network-vif-unplugged", "status": "completed", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Creating event network-vif-unplugged:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:25:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033711 Apr 12 06:25:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "name": "network-vif-deleted", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] Creating event network-vif-deleted:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:25:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040166 Apr 12 06:25:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 82/246] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:35 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33458552-cb23-41c7-9cb7-ef13301468f6", "name": "network-vif-plugged", "status": "completed", "tag": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Creating event network-vif-plugged:f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 on user Apr 12 06:25:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035005 Apr 12 06:25:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 84/247] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d7dfe38a-2284-460c-989f-c39d5ec63871 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045101 Apr 12 06:25:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:25:36 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-361839817"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:38 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-71f4a824-e2ba-46a0-9cd5-a3de24e663aa tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1658 microversion: 2.1 time: 0.177089 Apr 12 06:25:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:38 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1658 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d96a84d2-2151-4f60-a72b-25e84b80c975"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:38 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:39 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=47 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338526 Apr 12 06:25:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 83/250] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:25:38 2023] POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Creating event network-vif-plugged:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/action" status: 202 len: 0 microversion: 2.1 time: 1.369062 Apr 12 06:25:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 85/251] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:25:38 2023] POST /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/action => generated 0 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 06:25:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072588 Apr 12 06:25:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 84/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:40 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Going to try to start instance {{(pid=62041) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 06:25:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action" status: 202 len: 0 microversion: 2.1 time: 0.175525 Apr 12 06:25:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 84/253] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:25:40 2023] POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "44948ebb-503b-4166-936e-6c4101625453"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Creating event network-vif-plugged:44948ebb-503b-4166-936e-6c4101625453 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042698 Apr 12 06:25:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 85/254] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:25:40 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5f024958-d706-4d8f-883e-006ce47ec64b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1697 microversion: 2.1 time: 0.234248 Apr 12 06:25:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:40 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1697 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "350ec490-a274-4fe0-a88d-4d558e0d4337"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "350ec490-a274-4fe0-a88d-4d558e0d4337"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "36083c4a-f152-4716-a60d-0197287d6ba1"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "36083c4a-f152-4716-a60d-0197287d6ba1"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Creating event network-vif-plugged:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Creating event network-vif-plugged:350ec490-a274-4fe0-a88d-4d558e0d4337 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Creating event network-vif-plugged:350ec490-a274-4fe0-a88d-4d558e0d4337 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Creating event network-vif-plugged:36083c4a-f152-4716-a60d-0197287d6ba1 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Creating event network-vif-plugged:36083c4a-f152-4716-a60d-0197287d6ba1 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Creating event network-vif-plugged:22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.161933 Apr 12 06:25:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 85/256] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:42 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "44948ebb-503b-4166-936e-6c4101625453"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "be8e308b-ba21-4e98-95bf-af2ae6446d20"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Creating event network-vif-plugged:44948ebb-503b-4166-936e-6c4101625453 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Creating event network-vif-plugged:be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038623 Apr 12 06:25:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 86/257] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-07b67d95-645c-494c-8d97-22c46ffa5447 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1500 microversion: 2.1 time: 0.180235 Apr 12 06:25:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:43 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1500 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:25:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "dce0028f-1206-43bb-96c1-d3cbd8f57103"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "dce0028f-1206-43bb-96c1-d3cbd8f57103"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Creating event network-vif-plugged:22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Creating event network-vif-plugged:dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Creating event network-vif-plugged:dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048639 Apr 12 06:25:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 86/259] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:44 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "be8e308b-ba21-4e98-95bf-af2ae6446d20"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Creating event network-vif-plugged:be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:25:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035493 Apr 12 06:25:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 87/260] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:25:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:25:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044181 Apr 12 06:25:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:48 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-128c81e9-5263-462c-af99-b50224545bcf tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1704 microversion: 2.1 time: 0.156869 Apr 12 06:25:48 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 87/262] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:48 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1704 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1279128249", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: dict_keys(['metadata_items']) {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: dict_keys(['metadata_items']) {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/action" status: 202 len: 1159 microversion: 2.1 time: 0.419287 Apr 12 06:25:48 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 88/263] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 06:25:48 2023] POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/action => generated 1159 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 06:25:48 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:48 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:25:48 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044480 Apr 12 06:25:48 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:25:48 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:48 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ae42efc0-1d00-4564-bb2d-3d2a6263a36b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1732 microversion: 2.1 time: 0.212152 Apr 12 06:25:48 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:48 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:25:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-unplugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Creating event network-vif-unplugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:25:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059913 Apr 12 06:25:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 89/266] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-87019523", "imageRef": "1a9eeca1-ea38-407f-a16c-de352efc9154", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1405244377", "security_groups": [{"name": "tempest-secgroup-smoke-1617961673"}], "networks": [{"uuid": "85180900-1c38-4677-a676-89d6643196d0"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] validate_networks() for [('85180900-1c38-4677-a676-89d6643196d0', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:25:50 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting quotas for project 5a7d74130d4d417a93de352381229948. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting quotas for user d59314e79d0344a2943391c3c2ab628a and project 5a7d74130d4d417a93de352381229948. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:25:51 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a9eeca1-ea38-407f-a16c-de352efc9154',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:25:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.727013 Apr 12 06:25:51 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 90/267] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:25:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:25:51 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-627b1e7d-5ab8-4eae-89f8-569bbe6c2359 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:51 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-627b1e7d-5ab8-4eae-89f8-569bbe6c2359 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:51 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-627b1e7d-5ab8-4eae-89f8-569bbe6c2359 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-627b1e7d-5ab8-4eae-89f8-569bbe6c2359 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" status: 200 len: 1235 microversion: 2.1 time: 0.078364 Apr 12 06:25:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 89/268] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:51 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => generated 1235 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:25:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:25:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033398 Apr 12 06:25:51 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 90/269] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Creating event network-changed:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:25:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044141 Apr 12 06:25:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "name": "network-vif-plugged", "status": "completed", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Creating event network-vif-plugged:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:25:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076663 Apr 12 06:25:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 90/271] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:58 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "name": "network-vif-plugged", "status": "completed", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Creating event network-vif-plugged:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:25:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046479 Apr 12 06:25:58 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:25:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:25:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-431102723", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "3e68bc36-acaf-40c8-983d-8bd288d82224"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] validate_networks() for [('3e68bc36-acaf-40c8-983d-8bd288d82224', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Getting quotas for project d92928c7a0ed463bbd9020808578b263. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Getting quotas for user 13f5402fd38f40c08c30991ad78b7f58 and project d92928c7a0ed463bbd9020808578b263. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:25:59 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:25:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.734983 Apr 12 06:25:59 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 92/273] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:25:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:25:59 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7bc0d197-3ea3-48c1-8439-f578873f07c3 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:25:59 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7bc0d197-3ea3-48c1-8439-f578873f07c3 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:25:59 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-7bc0d197-3ea3-48c1-8439-f578873f07c3 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5402fd38f40c08c30991ad78b7f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92928c7a0ed463bbd9020808578b263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:25:59 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7bc0d197-3ea3-48c1-8439-f578873f07c3 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1" status: 200 len: 1207 microversion: 2.1 time: 0.110850 Apr 12 06:25:59 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 91/274] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:25:59 2023] GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1 => generated 1207 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] HTTP exception thrown: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Request method failure captured: Apr 12 06:26:00 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 HTTP/1.1 Apr 12 06:26:00 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:26:00 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:26:00 user devstack@n-api.service[62042]: Connection: close Apr 12 06:26:00 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:26:00 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:26:00 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:26:00 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:26:00 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk32WUhTkuNHXs1VqcthlMiYUAB3gh-ObZ7V0OEiNHFgXX0SsUM1vVZVPjG3fL45RCdRT9T_U83jeQFVL99PioKyqr_giORTHDXge51X4kNzaAon4WMBRtKILUFFa5LB8wbPyElaHNUkyz477bVcgYy_9RydvPZJx_y-8i39rDeN9pk Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Project-Id: 96d2a1b102d54e8194741137e193436f Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Project-Name: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96d2a1b102d54e8194741137e193436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96d2a1b102d54e8194741137e193436f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96d2a1b102d54e8194741137e193436f"}]}] Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Tenant: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Tenant-Id: 96d2a1b102d54e8194741137e193436f Apr 12 06:26:00 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:00 user devstack@n-api.service[62042]: X-User: tempest-TaggedAttachmentsTest-1179204824-project-member Apr 12 06:26:00 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:26:00 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:26:00 user devstack@n-api.service[62042]: X-User-Id: 896e1c5d0edd4a1d9d122115f02dfef7 Apr 12 06:26:00 user devstack@n-api.service[62042]: X-User-Name: tempest-TaggedAttachmentsTest-1179204824-project-member Apr 12 06:26:00 user devstack@n-api.service[62042]: method: > Apr 12 06:26:00 user devstack@n-api.service[62042]: exception: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:00 user devstack@n-api.service[62042]: action_args: {'id': '1c02afd2-428b-49c9-a5e9-016fdeab1046'} Apr 12 06:26:00 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Returning 404 to user: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:26:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4c7968a8-9672-4dce-9494-e6720715e23a tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 404 len: 111 microversion: 2.49 time: 0.075922 Apr 12 06:26:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 92/275] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:26:00 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:26:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-19e571c0-6b75-46af-ad0f-011d558d0a7f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '.version_select at 0x7fd24dda0550>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-19e571c0-6b75-46af-ad0f-011d558d0a7f tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020989553" status: 204 len: 0 microversion: 2.49 time: 0.026746 Apr 12 06:26:00 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 06:26:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020989553 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:26:02 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0f5f93-3d0f-483c-b467-63b83db9cce1", "tag": "f4d18025-6c85-4429-9b5a-59724be47184"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:02 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Creating event network-changed:f4d18025-6c85-4429-9b5a-59724be47184 for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 on user Apr 12 06:26:02 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037908 Apr 12 06:26:02 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 92/277] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] HTTP exception thrown: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Request method failure captured: Apr 12 06:26:02 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 HTTP/1.1 Apr 12 06:26:02 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:26:02 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:26:02 user devstack@n-api.service[62042]: Connection: close Apr 12 06:26:02 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:26:02 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:26:02 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:26:02 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:26:02 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk32WUhTkuNHXs1VqcthlMiYUAB3gh-ObZ7V0OEiNHFgXX0SsUM1vVZVPjG3fL45RCdRT9T_U83jeQFVL99PioKyqr_giORTHDXge51X4kNzaAon4WMBRtKILUFFa5LB8wbPyElaHNUkyz477bVcgYy_9RydvPZJx_y-8i39rDeN9pk Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Project-Id: 96d2a1b102d54e8194741137e193436f Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Project-Name: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96d2a1b102d54e8194741137e193436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96d2a1b102d54e8194741137e193436f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96d2a1b102d54e8194741137e193436f"}]}] Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Tenant: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Tenant-Id: 96d2a1b102d54e8194741137e193436f Apr 12 06:26:02 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:02 user devstack@n-api.service[62042]: X-User: tempest-TaggedAttachmentsTest-1179204824-project-member Apr 12 06:26:02 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:26:02 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:26:02 user devstack@n-api.service[62042]: X-User-Id: 896e1c5d0edd4a1d9d122115f02dfef7 Apr 12 06:26:02 user devstack@n-api.service[62042]: X-User-Name: tempest-TaggedAttachmentsTest-1179204824-project-member Apr 12 06:26:02 user devstack@n-api.service[62042]: method: > Apr 12 06:26:02 user devstack@n-api.service[62042]: exception: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62042]: action_args: {'id': '1c02afd2-428b-49c9-a5e9-016fdeab1046'} Apr 12 06:26:02 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Returning 404 to user: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:26:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-57da9b23-3bef-463a-901e-7e17c1c66f75 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 404 len: 111 microversion: 2.49 time: 0.035670 Apr 12 06:26:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 93/278] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:26:02 2023] DELETE /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:02 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] HTTP exception thrown: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Request method failure captured: Apr 12 06:26:02 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 HTTP/1.1 Apr 12 06:26:02 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:26:02 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:26:02 user devstack@n-api.service[62040]: Connection: close Apr 12 06:26:02 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:26:02 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:26:02 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:26:02 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:26:02 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk32WUhTkuNHXs1VqcthlMiYUAB3gh-ObZ7V0OEiNHFgXX0SsUM1vVZVPjG3fL45RCdRT9T_U83jeQFVL99PioKyqr_giORTHDXge51X4kNzaAon4WMBRtKILUFFa5LB8wbPyElaHNUkyz477bVcgYy_9RydvPZJx_y-8i39rDeN9pk Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Project-Id: 96d2a1b102d54e8194741137e193436f Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Project-Name: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96d2a1b102d54e8194741137e193436f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96d2a1b102d54e8194741137e193436f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96d2a1b102d54e8194741137e193436f"}]}] Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Tenant: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Tenant-Id: 96d2a1b102d54e8194741137e193436f Apr 12 06:26:02 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1179204824 Apr 12 06:26:02 user devstack@n-api.service[62040]: X-User: tempest-TaggedAttachmentsTest-1179204824-project-member Apr 12 06:26:02 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:26:02 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:26:02 user devstack@n-api.service[62040]: X-User-Id: 896e1c5d0edd4a1d9d122115f02dfef7 Apr 12 06:26:02 user devstack@n-api.service[62040]: X-User-Name: tempest-TaggedAttachmentsTest-1179204824-project-member Apr 12 06:26:02 user devstack@n-api.service[62040]: method: > Apr 12 06:26:02 user devstack@n-api.service[62040]: exception: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62040]: action_args: {'id': '1c02afd2-428b-49c9-a5e9-016fdeab1046'} Apr 12 06:26:02 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. Apr 12 06:26:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Returning 404 to user: Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:26:02 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-577aaeb4-5f6f-455a-b2e6-eb276323c560 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046" status: 404 len: 111 microversion: 2.49 time: 0.035342 Apr 12 06:26:02 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 94/279] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:26:02 2023] GET /compute/v2.1/servers/1c02afd2-428b-49c9-a5e9-016fdeab1046 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 06:26:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f5f93-3d0f-483c-b467-63b83db9cce1", "name": "network-vif-plugged", "status": "completed", "tag": "f4d18025-6c85-4429-9b5a-59724be47184"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:06 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Creating event network-vif-plugged:f4d18025-6c85-4429-9b5a-59724be47184 for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 on user Apr 12 06:26:06 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045879 Apr 12 06:26:06 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 93/280] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:07 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f5f93-3d0f-483c-b467-63b83db9cce1", "name": "network-vif-plugged", "status": "completed", "tag": "f4d18025-6c85-4429-9b5a-59724be47184"}, {"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}, {"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Creating event network-vif-plugged:f4d18025-6c85-4429-9b5a-59724be47184 for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 on user Apr 12 06:26:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:26:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:26:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042616 Apr 12 06:26:08 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 95/281] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:08 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:08 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:08 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ed54d55f-7781-4fbf-8e6b-7cfc30e3f0e3 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 200 len: 2821 microversion: 2.32 time: 0.624838 Apr 12 06:26:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 94/282] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:26:07 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 2821 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] HTTP exception thrown: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Request method failure captured: Apr 12 06:26:08 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 HTTP/1.1 Apr 12 06:26:08 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:26:08 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:26:08 user devstack@n-api.service[62041]: Connection: close Apr 12 06:26:08 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:26:08 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:26:08 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:26:08 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:26:08 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3toJs0XnKzJ3t3HYlTe5pTa7lFGnpTpzz0-uCRFnIBY7nyVdsp0LbwGy6E4zv_mRQ00byIQNRmiEZsxEcXmEgn2-PLwcC3mzLzRxiefRFpnIfB7kw8VyjSnBu5RIXv-Rjv5-ZtOWwLA_vwC-VtuotNEZSf4FsVwpyDxX3DF0T7X-c Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Project-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}] Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Tenant: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Tenant-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:26:08 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:26:08 user devstack@n-api.service[62041]: X-User: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:26:08 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:26:08 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:26:08 user devstack@n-api.service[62041]: X-User-Id: e761442395d14d7f82216e3d4174e43a Apr 12 06:26:08 user devstack@n-api.service[62041]: X-User-Name: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:26:08 user devstack@n-api.service[62041]: method: > Apr 12 06:26:08 user devstack@n-api.service[62041]: exception: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:26:08 user devstack@n-api.service[62041]: action_args: {'id': '2a24ff32-6994-4754-be34-7664bbe21d16'} Apr 12 06:26:08 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:26:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:26:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Returning 404 to user: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:26:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-23b9ff10-59b4-45e9-b379-232132bd87aa tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 404 len: 111 microversion: 2.1 time: 0.047468 Apr 12 06:26:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 94/283] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:08 2023] GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:09 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f40a488d-58b7-4957-bedb-9088c3ea5513 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1494 microversion: 2.1 time: 0.162766 Apr 12 06:26:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:08 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1494 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:21 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=35 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:21 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-996712143", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "c152f4eb-1dbe-4252-b242-3f911e389655"}]}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] validate_networks() for [('c152f4eb-1dbe-4252-b242-3f911e389655', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for user 2e5e4455358643b8830ce8c96aad5aad and project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:26:22 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:26:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.822722 Apr 12 06:26:22 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 95/285] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:26:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:26:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-940cc614-74e3-445a-9bfb-76fdb3510487 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:22 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-940cc614-74e3-445a-9bfb-76fdb3510487 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=27 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:23 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-940cc614-74e3-445a-9bfb-76fdb3510487 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:23 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-940cc614-74e3-445a-9bfb-76fdb3510487 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:23 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-940cc614-74e3-445a-9bfb-76fdb3510487 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-940cc614-74e3-445a-9bfb-76fdb3510487 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f" status: 200 len: 1394 microversion: 2.87 time: 0.387275 Apr 12 06:26:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 95/286] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:26:22 2023] GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f => generated 1394 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] HTTP exception thrown: Instance 33458552-cb23-41c7-9cb7-ef13301468f6 could not be found. Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Request method failure captured: Apr 12 06:26:23 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6 HTTP/1.1 Apr 12 06:26:23 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:26:23 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:26:23 user devstack@n-api.service[62040]: Connection: close Apr 12 06:26:23 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:26:23 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:26:23 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:26:23 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:26:23 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk35p3-DeSSizX2w6uYsbx27aMFnwcs20ssfyjVSBnsfX92MBLowQ54cYy74WcQG2LDm3goK0I2jJMMYMmn7oJcBv3YezLMh1mXkOibr5Kq_MGTAXLAeFtKbc8QOQ3MIu4Cr0GiruEv7prT1yznuMjX3eEyQ6d93QtDUMt60i4qk5TM Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Project-Id: ff56a846b9e34aada0c72df46d47b77d Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestVolumeSwap-1856443697 Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ff56a846b9e34aada0c72df46d47b77d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ff56a846b9e34aada0c72df46d47b77d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ff56a846b9e34aada0c72df46d47b77d"}]}] Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Tenant: tempest-TestVolumeSwap-1856443697 Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Tenant-Id: ff56a846b9e34aada0c72df46d47b77d Apr 12 06:26:23 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestVolumeSwap-1856443697 Apr 12 06:26:23 user devstack@n-api.service[62040]: X-User: tempest-TestVolumeSwap-1856443697-project-member Apr 12 06:26:23 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:26:23 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:26:23 user devstack@n-api.service[62040]: X-User-Id: f053ed1c99c0480c9d1b0bc466e49e08 Apr 12 06:26:23 user devstack@n-api.service[62040]: X-User-Name: tempest-TestVolumeSwap-1856443697-project-member Apr 12 06:26:23 user devstack@n-api.service[62040]: method: > Apr 12 06:26:23 user devstack@n-api.service[62040]: exception: Instance 33458552-cb23-41c7-9cb7-ef13301468f6 could not be found. Apr 12 06:26:23 user devstack@n-api.service[62040]: action_args: {'id': '33458552-cb23-41c7-9cb7-ef13301468f6'} Apr 12 06:26:23 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33458552-cb23-41c7-9cb7-ef13301468f6 could not be found. Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33458552-cb23-41c7-9cb7-ef13301468f6 could not be found. Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33458552-cb23-41c7-9cb7-ef13301468f6 could not be found. Apr 12 06:26:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:26:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Returning 404 to user: Instance 33458552-cb23-41c7-9cb7-ef13301468f6 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:26:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-8fbcf74c-4428-455a-b47f-78f694c9dfbc tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6" status: 404 len: 111 microversion: 2.1 time: 0.037961 Apr 12 06:26:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:23 2023] GET /compute/v2.1/servers/33458552-cb23-41c7-9cb7-ef13301468f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 06:26:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c8083872-39ad-4996-964d-100126060b00 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Calling method '.version_select at 0x7fd24ddebbe0>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c8083872-39ad-4996-964d-100126060b00 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426278107" status: 202 len: 0 microversion: 2.1 time: 0.037080 Apr 12 06:26:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 96/288] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:26:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426278107 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:26:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a6c87b7-75d7-429e-9f7b-e8a959f1791f", "tag": "c9e9de0e-798c-49fb-aeb3-30eccc267206"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Creating event network-changed:c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f on user Apr 12 06:26:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043703 Apr 12 06:26:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:28 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6c87b7-75d7-429e-9f7b-e8a959f1791f", "name": "network-vif-plugged", "status": "completed", "tag": "c9e9de0e-798c-49fb-aeb3-30eccc267206"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Creating event network-vif-plugged:c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f on user Apr 12 06:26:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031285 Apr 12 06:26:28 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:26:30 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6c87b7-75d7-429e-9f7b-e8a959f1791f", "name": "network-vif-plugged", "status": "completed", "tag": "c9e9de0e-798c-49fb-aeb3-30eccc267206"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:30 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Creating event network-vif-plugged:c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f on user Apr 12 06:26:30 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029227 Apr 12 06:26:30 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 97/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:31 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-42bbf869-d0f8-46c7-b90e-309cda042886 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1701 microversion: 2.1 time: 0.188975 Apr 12 06:26:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 97/292] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:30 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1701 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:39 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e202d830-5140-4a01-8702-3892fb4cbb24 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1723 microversion: 2.1 time: 0.378061 Apr 12 06:26:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 99/293] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:38 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:41 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-24830747-d35c-41af-a0c7-540c4e8e9aad tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" status: 200 len: 1537 microversion: 2.1 time: 0.383420 Apr 12 06:26:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:41 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => generated 1537 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62041) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 06:26:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6/action" status: 202 len: 0 microversion: 2.1 time: 0.134252 Apr 12 06:26:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 98/295] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:26:43 2023] POST /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:26:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:44 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c7d90984-3975-43b3-83c4-6a76bed4635b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1508 microversion: 2.1 time: 0.170591 Apr 12 06:26:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:43 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:49 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5402fd38f40c08c30991ad78b7f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92928c7a0ed463bbd9020808578b263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-6e7b6751-97a0-4863-962b-01a6c03001ef tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1" status: 200 len: 1485 microversion: 2.1 time: 0.189901 Apr 12 06:26:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 99/297] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:49 2023] GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1 => generated 1485 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:51 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Creating event network-changed:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:26:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236682 Apr 12 06:26:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 99/298] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:26:51 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f8571d87-edba-4daa-b7a1-456f7aa38df3 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Action: 'create', calling method: .version_select at 0x7fd24dda1c60>, body: {"keypair": {"name": "tempest-keypair-1771315456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD65dE2pmIa6Mfx/K+bCSPXnuq3dvIWAreTtSp1xAwHIKyD+AYVbf8VY+daMgeHQNbUc8pnSFCiLNei+4la99e6HF1pBOjNJp35njArMoDgjdZo+g6dLiFEWe9TBcGXsNg=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:51 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-f8571d87-edba-4daa-b7a1-456f7aa38df3 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting quotas for project 0b656fa0bf05484889563c50ccc9a7e9. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:26:51 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-f8571d87-edba-4daa-b7a1-456f7aa38df3 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting quotas for user d682efe6338b4989beb714cce25e8e31 and project 0b656fa0bf05484889563c50ccc9a7e9. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:26:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f8571d87-edba-4daa-b7a1-456f7aa38df3 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167555 Apr 12 06:26:51 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:26:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-322960618", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189"}], "security_groups": [{"name": "tempest-securitygroup--930941806"}], "key_name": "tempest-keypair-1771315456", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] validate_networks() for [('dcf0c385-b3ea-4b92-8d8d-a0e1243f6189', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting quotas for project 0b656fa0bf05484889563c50ccc9a7e9. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting quotas for user d682efe6338b4989beb714cce25e8e31 and project 0b656fa0bf05484889563c50ccc9a7e9. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:26:53 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:26:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.650900 Apr 12 06:26:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 100/300] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:26:53 2023] POST /compute/v2.1/servers => generated 403 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:26:53 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7e26b9b9-08a8-49f4-b73b-66d31e5ae8dc tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:26:53 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7e26b9b9-08a8-49f4-b73b-66d31e5ae8dc tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:26:53 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-7e26b9b9-08a8-49f4-b73b-66d31e5ae8dc tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:26:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7e26b9b9-08a8-49f4-b73b-66d31e5ae8dc tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094" status: 200 len: 1235 microversion: 2.1 time: 0.066841 Apr 12 06:26:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 100/301] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:26:53 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094 => generated 1235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:26:54 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=16 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:26:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-plugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Creating event network-vif-plugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:26:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094689 Apr 12 06:26:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 102/302] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Creating event network-changed:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:26:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031389 Apr 12 06:26:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 101/303] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-plugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Creating event network-vif-plugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:26:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029225 Apr 12 06:26:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 101/304] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:26:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "name": "network-vif-plugged", "status": "completed", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:26:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:26:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:26:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:26:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Creating event network-vif-plugged:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:26:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096575 Apr 12 06:26:58 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 103/305] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "name": "network-vif-plugged", "status": "completed", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Creating event network-vif-plugged:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:27:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Apr 12 06:27:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 102/306] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7ef53425-da39-42ca-8582-15011625d9c1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.189555 Apr 12 06:27:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 102/307] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:27:08 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4/os-interface => generated 1828 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Creating event network-changed:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041041 Apr 12 06:27:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 104/308] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c9e7b99b-9d53-4fb9-ab9b-0f8992cb6b53 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 200 len: 2821 microversion: 2.32 time: 0.650759 Apr 12 06:27:10 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 103/309] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:27:09 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 2821 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-39fdf3be-0879-4b8a-a739-89eb4b4a1353 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.148543 Apr 12 06:27:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 103/310] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:27:10 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4/os-interface => generated 1828 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:27:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-272e39a4-307e-4c82-8363-17b58d483a63 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-692509909", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "859868f9-52cb-46c1-95b8-6ca520e4fae3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c388c547-af8b-4a08-a268-43eb751fa0c1"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-272e39a4-307e-4c82-8363-17b58d483a63 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] HTTP exception thrown: Block Device 859868f9-52cb-46c1-95b8-6ca520e4fae3 is not bootable. Apr 12 06:27:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-272e39a4-307e-4c82-8363-17b58d483a63 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Request method failure captured: Apr 12 06:27:10 user devstack@n-api.service[62040]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 06:27:10 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:27:10 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:27:10 user devstack@n-api.service[62040]: Connection: close Apr 12 06:27:10 user devstack@n-api.service[62040]: Content-Length: 356 Apr 12 06:27:10 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:27:10 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:27:10 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:27:10 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk3toJs0XnKzJ3t3HYlTe5pTa7lFGnpTpzz0-uCRFnIBY7nyVdsp0LbwGy6E4zv_mRQ00byIQNRmiEZsxEcXmEgn2-PLwcC3mzLzRxiefRFpnIfB7kw8VyjSnBu5RIXv-Rjv5-ZtOWwLA_vwC-VtuotNEZSf4FsVwpyDxX3DF0T7X-c Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Project-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Project-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}] Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Tenant: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Tenant-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:27:10 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:27:10 user devstack@n-api.service[62040]: X-User: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:27:10 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:27:10 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:27:10 user devstack@n-api.service[62040]: X-User-Id: e761442395d14d7f82216e3d4174e43a Apr 12 06:27:10 user devstack@n-api.service[62040]: X-User-Name: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:27:10 user devstack@n-api.service[62040]: Apr 12 06:27:10 user devstack@n-api.service[62040]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-692509909", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "859868f9-52cb-46c1-95b8-6ca520e4fae3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c388c547-af8b-4a08-a268-43eb751fa0c1"}]}} Apr 12 06:27:10 user devstack@n-api.service[62040]: method: > Apr 12 06:27:10 user devstack@n-api.service[62040]: exception: Block Device 859868f9-52cb-46c1-95b8-6ca520e4fae3 is not bootable. Apr 12 06:27:10 user devstack@n-api.service[62040]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-692509909', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '859868f9-52cb-46c1-95b8-6ca520e4fae3'}], 'networks': [{'uuid': 'c388c547-af8b-4a08-a268-43eb751fa0c1'}]}}} Apr 12 06:27:10 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 859868f9-52cb-46c1-95b8-6ca520e4fae3 is not bootable. Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 859868f9-52cb-46c1-95b8-6ca520e4fae3 is not bootable. Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 859868f9-52cb-46c1-95b8-6ca520e4fae3 is not bootable. Apr 12 06:27:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:27:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-272e39a4-307e-4c82-8363-17b58d483a63 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Returning 400 to user: Block Device 859868f9-52cb-46c1-95b8-6ca520e4fae3 is not bootable. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:27:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-272e39a4-307e-4c82-8363-17b58d483a63 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.072937 Apr 12 06:27:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 105/311] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:27:10 2023] POST /compute/v2.1/servers => generated 110 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:11 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-5b8dc7be-9fb0-43b6-8248-b4c432929d53 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1494 microversion: 2.1 time: 0.139449 Apr 12 06:27:11 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 104/312] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:10 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1494 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:11 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:27:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 204 len: 0 microversion: 2.32 time: 0.132986 Apr 12 06:27:11 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 104/313] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:27:11 2023] DELETE /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:11 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:11 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e1278028-d91f-4fe2-8941-5630346109a8 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 200 len: 2945 microversion: 2.32 time: 0.297945 Apr 12 06:27:11 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 106/314] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:27:11 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 2945 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 06:27:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=31 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Creating event network-vif-unplugged:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035596 Apr 12 06:27:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 105/315] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "44948ebb-503b-4166-936e-6c4101625453"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Creating event network-vif-unplugged:44948ebb-503b-4166-936e-6c4101625453 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036262 Apr 12 06:27:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:13 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2da5ec42-19ed-4026-b573-ff15dbcddf04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f" status: 200 len: 1690 microversion: 2.87 time: 0.355757 Apr 12 06:27:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:27:13 2023] GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f => generated 1690 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:27:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "350ec490-a274-4fe0-a88d-4d558e0d4337"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "350ec490-a274-4fe0-a88d-4d558e0d4337"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "36083c4a-f152-4716-a60d-0197287d6ba1"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "36083c4a-f152-4716-a60d-0197287d6ba1"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "dce0028f-1206-43bb-96c1-d3cbd8f57103"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "dce0028f-1206-43bb-96c1-d3cbd8f57103"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-plugged:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-unplugged:350ec490-a274-4fe0-a88d-4d558e0d4337 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-plugged:350ec490-a274-4fe0-a88d-4d558e0d4337 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-unplugged:36083c4a-f152-4716-a60d-0197287d6ba1 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-plugged:36083c4a-f152-4716-a60d-0197287d6ba1 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-unplugged:22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-plugged:22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-unplugged:dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Creating event network-vif-plugged:dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "44948ebb-503b-4166-936e-6c4101625453"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-unplugged", "status": "completed", "tag": "be8e308b-ba21-4e98-95bf-af2ae6446d20"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-plugged", "status": "completed", "tag": "be8e308b-ba21-4e98-95bf-af2ae6446d20"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1559 microversion: 2.1 time: 0.040493 Apr 12 06:27:14 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 106/318] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 06:27:14 2023] POST /compute/v2.1/os-server-external-events => generated 1559 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Creating event network-vif-plugged:44948ebb-503b-4166-936e-6c4101625453 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Creating event network-vif-unplugged:be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Creating event network-vif-plugged:be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033304 Apr 12 06:27:14 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 106/319] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:14 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:16 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-deleted", "tag": "be8e308b-ba21-4e98-95bf-af2ae6446d20"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:16 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] Creating event network-vif-deleted:be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:16 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032904 Apr 12 06:27:16 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 108/320] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-deleted", "tag": "36083c4a-f152-4716-a60d-0197287d6ba1"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-deleted", "tag": "dce0028f-1206-43bb-96c1-d3cbd8f57103"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-deleted", "tag": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c"}, {"server_uuid": "d15be760-180e-4335-b670-ecd8873609b4", "name": "network-vif-deleted", "tag": "84ce2803-724b-484e-8673-6959fd03fdc9"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Creating event network-vif-deleted:36083c4a-f152-4716-a60d-0197287d6ba1 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Creating event network-vif-deleted:dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Creating event network-vif-deleted:22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] Creating event network-vif-deleted:84ce2803-724b-484e-8673-6959fd03fdc9 for instance d15be760-180e-4335-b670-ecd8873609b4 on user Apr 12 06:27:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.033372 Apr 12 06:27:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 107/321] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:18 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:31 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'services' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:27:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-volume_attachments/34023a39-bbf4-4afb-948b-0bff9f563bb8" status: 202 len: 0 microversion: 2.1 time: 0.292181 Apr 12 06:27:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:27:31 2023] DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-volume_attachments/34023a39-bbf4-4afb-948b-0bff9f563bb8 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=16 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Going to try to stop instance {{(pid=62040) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 06:27:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action" status: 202 len: 0 microversion: 2.1 time: 0.164378 Apr 12 06:27:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 109/323] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:27:33 2023] POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=5 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=5 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:34 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-16e717ed-93fc-40f2-997d-1a57572dc0ac tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1665 microversion: 2.1 time: 0.166251 Apr 12 06:27:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:33 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-unplugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Creating event network-vif-unplugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030071 Apr 12 06:27:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 108/325] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d5b772f5-60c4-455e-8c14-ec13c1ee0041 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1553 microversion: 2.1 time: 0.184426 Apr 12 06:27:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:34 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:27:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036224 Apr 12 06:27:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 109/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:39 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fb9a2bf0-7dfd-4fa2-89d1-ba1cca4e274c tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1723 microversion: 2.1 time: 0.267722 Apr 12 06:27:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 109/328] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:39 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:39 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2d409462-8123-4aeb-b891-cdd2c4a0099a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1723 microversion: 2.1 time: 0.151829 Apr 12 06:27:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 111/329] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:39 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:41 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d4539f6d-0d65-487a-9d6e-731ce6659983 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" status: 200 len: 1537 microversion: 2.1 time: 0.262262 Apr 12 06:27:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 110/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:41 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Creating event network-changed:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:27:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028769 Apr 12 06:27:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 110/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff8cf913-7198-47e1-adda-fe9fff61c36b"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "POST /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281037 Apr 12 06:27:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 112/332] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:27:43 2023] POST /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:44 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-f4a333c6-b342-4b8a-bc55-47e16fbdaacd tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094" status: 200 len: 1543 microversion: 2.1 time: 0.253649 Apr 12 06:27:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:43 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094 => generated 1543 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:50 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'services' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:27:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments/ff8cf913-7198-47e1-adda-fe9fff61c36b" status: 202 len: 0 microversion: 2.1 time: 0.165670 Apr 12 06:27:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 111/334] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:27:50 2023] DELETE /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments/ff8cf913-7198-47e1-adda-fe9fff61c36b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-07bdf771-dbd5-4399-9da0-eca62f1b3682 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057392 Apr 12 06:27:51 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:27:51 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=20 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:54 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:27:54 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1" status: 204 len: 0 microversion: 2.1 time: 0.123586 Apr 12 06:27:54 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 112/336] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:27:54 2023] DELETE /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:54 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5402fd38f40c08c30991ad78b7f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92928c7a0ed463bbd9020808578b263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:27:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a3d979ad-2c73-4ebb-8d60-6c6b83c628b1 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1" status: 200 len: 1491 microversion: 2.1 time: 0.172143 Apr 12 06:27:54 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 112/337] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:27:54 2023] GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1 => generated 1491 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:27:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f5f93-3d0f-483c-b467-63b83db9cce1", "name": "network-vif-unplugged", "status": "completed", "tag": "f4d18025-6c85-4429-9b5a-59724be47184"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Creating event network-vif-unplugged:f4d18025-6c85-4429-9b5a-59724be47184 for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 on user Apr 12 06:27:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028910 Apr 12 06:27:55 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 114/338] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f5f93-3d0f-483c-b467-63b83db9cce1", "name": "network-vif-deleted", "tag": "f4d18025-6c85-4429-9b5a-59724be47184"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] Creating event network-vif-deleted:f4d18025-6c85-4429-9b5a-59724be47184 for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 on user Apr 12 06:27:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029052 Apr 12 06:27:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 113/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:27:57 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f5f93-3d0f-483c-b467-63b83db9cce1", "name": "network-vif-plugged", "status": "completed", "tag": "f4d18025-6c85-4429-9b5a-59724be47184"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:27:57 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:27:57 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:27:57 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:27:57 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Creating event network-vif-plugged:f4d18025-6c85-4429-9b5a-59724be47184 for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 on user Apr 12 06:27:57 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029090 Apr 12 06:27:57 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 113/340] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:02 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] HTTP exception thrown: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Request method failure captured: Apr 12 06:28:02 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 HTTP/1.1 Apr 12 06:28:02 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:28:02 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:28:02 user devstack@n-api.service[62040]: Connection: close Apr 12 06:28:02 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:28:02 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:28:02 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:28:02 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:28:02 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk643TytJHq-J2QiWWxwSwPO55it9mRrcBFYTj7zVgmuwcLeZj5gDBBYuQXpQYo0xl3IXf9dWFg1rxvLWzZNYzKlnKD1vIp_QGtWFnQHvS1LseUy8AzprX2VvXMXWopzpSlcNGWp51PKiIOdQOImBUDbmt7vxjZgqQHfQHCn-28oeWo Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Project-Id: 6b22588bca2c46f09b19d28bcf76db06 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Project-Name: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b22588bca2c46f09b19d28bcf76db06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b22588bca2c46f09b19d28bcf76db06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b22588bca2c46f09b19d28bcf76db06"}]}] Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Tenant: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Tenant-Id: 6b22588bca2c46f09b19d28bcf76db06 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:02 user devstack@n-api.service[62040]: X-User: tempest-TaggedBootDevicesTest-1618985724-project-member Apr 12 06:28:02 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:28:02 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:28:02 user devstack@n-api.service[62040]: X-User-Id: 38d195bbdaf94ac9bfdba8f76157a10f Apr 12 06:28:02 user devstack@n-api.service[62040]: X-User-Name: tempest-TaggedBootDevicesTest-1618985724-project-member Apr 12 06:28:02 user devstack@n-api.service[62040]: method: > Apr 12 06:28:02 user devstack@n-api.service[62040]: exception: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:02 user devstack@n-api.service[62040]: action_args: {'id': 'd15be760-180e-4335-b670-ecd8873609b4'} Apr 12 06:28:02 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:02 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Returning 404 to user: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:28:02 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6e3c5a59-7db5-429f-a4a3-0fed4499487a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 404 len: 111 microversion: 2.32 time: 0.038984 Apr 12 06:28:02 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 115/341] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:28:02 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:28:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8a634e8f-f3df-47f1-9491-66ce0ccbab71 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '.version_select at 0x7fd24ddebbe0>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8a634e8f-f3df-47f1-9491-66ce0ccbab71 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769866146" status: 204 len: 0 microversion: 2.32 time: 0.029935 Apr 12 06:28:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 114/342] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 06:28:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769866146 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=15 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:04 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] HTTP exception thrown: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Request method failure captured: Apr 12 06:28:05 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 HTTP/1.1 Apr 12 06:28:05 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:28:05 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:28:05 user devstack@n-api.service[62041]: Connection: close Apr 12 06:28:05 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:28:05 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:28:05 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:28:05 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:28:05 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk643TytJHq-J2QiWWxwSwPO55it9mRrcBFYTj7zVgmuwcLeZj5gDBBYuQXpQYo0xl3IXf9dWFg1rxvLWzZNYzKlnKD1vIp_QGtWFnQHvS1LseUy8AzprX2VvXMXWopzpSlcNGWp51PKiIOdQOImBUDbmt7vxjZgqQHfQHCn-28oeWo Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Project-Id: 6b22588bca2c46f09b19d28bcf76db06 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Project-Name: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b22588bca2c46f09b19d28bcf76db06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b22588bca2c46f09b19d28bcf76db06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b22588bca2c46f09b19d28bcf76db06"}]}] Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Tenant: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Tenant-Id: 6b22588bca2c46f09b19d28bcf76db06 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:05 user devstack@n-api.service[62041]: X-User: tempest-TaggedBootDevicesTest-1618985724-project-member Apr 12 06:28:05 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:28:05 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:28:05 user devstack@n-api.service[62041]: X-User-Id: 38d195bbdaf94ac9bfdba8f76157a10f Apr 12 06:28:05 user devstack@n-api.service[62041]: X-User-Name: tempest-TaggedBootDevicesTest-1618985724-project-member Apr 12 06:28:05 user devstack@n-api.service[62041]: method: > Apr 12 06:28:05 user devstack@n-api.service[62041]: exception: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62041]: action_args: {'id': 'd15be760-180e-4335-b670-ecd8873609b4'} Apr 12 06:28:05 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Returning 404 to user: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:28:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-eca5d260-59f6-4e11-9f03-a420415809b1 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 404 len: 111 microversion: 2.32 time: 0.038168 Apr 12 06:28:05 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 114/343] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:28:04 2023] DELETE /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=15 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] HTTP exception thrown: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Request method failure captured: Apr 12 06:28:05 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 HTTP/1.1 Apr 12 06:28:05 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:28:05 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:28:05 user devstack@n-api.service[62040]: Connection: close Apr 12 06:28:05 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:28:05 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:28:05 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:28:05 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:28:05 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk643TytJHq-J2QiWWxwSwPO55it9mRrcBFYTj7zVgmuwcLeZj5gDBBYuQXpQYo0xl3IXf9dWFg1rxvLWzZNYzKlnKD1vIp_QGtWFnQHvS1LseUy8AzprX2VvXMXWopzpSlcNGWp51PKiIOdQOImBUDbmt7vxjZgqQHfQHCn-28oeWo Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Project-Id: 6b22588bca2c46f09b19d28bcf76db06 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Project-Name: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b22588bca2c46f09b19d28bcf76db06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b22588bca2c46f09b19d28bcf76db06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b22588bca2c46f09b19d28bcf76db06"}]}] Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Tenant: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Tenant-Id: 6b22588bca2c46f09b19d28bcf76db06 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1618985724 Apr 12 06:28:05 user devstack@n-api.service[62040]: X-User: tempest-TaggedBootDevicesTest-1618985724-project-member Apr 12 06:28:05 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:28:05 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:28:05 user devstack@n-api.service[62040]: X-User-Id: 38d195bbdaf94ac9bfdba8f76157a10f Apr 12 06:28:05 user devstack@n-api.service[62040]: X-User-Name: tempest-TaggedBootDevicesTest-1618985724-project-member Apr 12 06:28:05 user devstack@n-api.service[62040]: method: > Apr 12 06:28:05 user devstack@n-api.service[62040]: exception: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62040]: action_args: {'id': 'd15be760-180e-4335-b670-ecd8873609b4'} Apr 12 06:28:05 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. Apr 12 06:28:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Returning 404 to user: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:28:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-26b000eb-3a7f-46a7-b297-2c61ee5a9597 tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4" status: 404 len: 111 microversion: 2.32 time: 0.036210 Apr 12 06:28:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 116/344] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:28:05 2023] GET /compute/v2.1/servers/d15be760-180e-4335-b670-ecd8873609b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:11 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-58023855-b04e-4dbc-9a6f-9a5534c19cce tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1494 microversion: 2.1 time: 0.159944 Apr 12 06:28:11 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 115/345] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:11 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1494 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1309363557"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/action" status: 202 len: 52 microversion: 2.87 time: 0.797038 Apr 12 06:28:14 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 115/346] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:28:13 2023] POST /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/action => generated 52 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:19 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b0c61f45-40d3-4243-a506-a4eecbbc85e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f" status: 200 len: 1690 microversion: 2.87 time: 0.210496 Apr 12 06:28:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 117/347] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:28:19 2023] GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:24 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9ae0ed82-f99e-4ba1-bf08-33a091e5c561 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1642 microversion: 2.1 time: 0.216861 Apr 12 06:28:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:24 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1642 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:28:25 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:25 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:25 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-457399220", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] validate_networks() for [('98448a26-3482-4eb6-91b1-bf8b0c18a3eb', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for user dc8e6af1db834409a4880040a5ef6a5a and project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:28:26 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:28:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.699175 Apr 12 06:28:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 116/349] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:28:25 2023] POST /compute/v2.1/servers => generated 381 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:28:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b6ed1e9b-eff8-4f2d-947e-c2dfef2e926b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:26 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b6ed1e9b-eff8-4f2d-947e-c2dfef2e926b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:26 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b6ed1e9b-eff8-4f2d-947e-c2dfef2e926b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b6ed1e9b-eff8-4f2d-947e-c2dfef2e926b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1215 microversion: 2.1 time: 0.063431 Apr 12 06:28:26 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:26 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:28:26 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-335972391", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:26 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] validate_networks() for [('98448a26-3482-4eb6-91b1-bf8b0c18a3eb', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for user dc8e6af1db834409a4880040a5ef6a5a and project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:28:27 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:28:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.503634 Apr 12 06:28:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 117/351] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:28:26 2023] POST /compute/v2.1/servers => generated 381 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:28:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b1e6322b-eeaa-4928-8b40-b2f90e116148 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:27 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b1e6322b-eeaa-4928-8b40-b2f90e116148 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:27 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-b1e6322b-eeaa-4928-8b40-b2f90e116148 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b1e6322b-eeaa-4928-8b40-b2f90e116148 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 200 len: 1215 microversion: 2.1 time: 0.061365 Apr 12 06:28:27 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 117/352] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:27 2023] GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 1215 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:28:28 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Creating event network-changed:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:28:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029113 Apr 12 06:28:28 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 119/353] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Creating event network-changed:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:28:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030096 Apr 12 06:28:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 118/354] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:31 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}, {"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:28:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:28:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036834 Apr 12 06:28:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 118/355] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-plugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}, {"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-plugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Creating event network-vif-plugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:28:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Creating event network-vif-plugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:28:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029768 Apr 12 06:28:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 120/356] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Creating event network-changed:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:28:35 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:28:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031214 Apr 12 06:28:35 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 119/357] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 204 len: 0 microversion: 2.1 time: 0.124751 Apr 12 06:28:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 119/358] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:28:35 2023] DELETE /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:35 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-14116ba0-3086-4a56-ad5f-29570237669c tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 200 len: 1559 microversion: 2.1 time: 0.255909 Apr 12 06:28:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 121/359] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:35 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:28:37 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-deleted", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:37 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] Creating event network-vif-deleted:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:28:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Apr 12 06:28:37 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 120/360] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-unplugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}, {"server_uuid": "7141c80d-34a9-40cc-a792-b01ffd9155b6", "name": "network-vif-plugged", "status": "completed", "tag": "f2b23249-b032-47f5-973e-922f210b40b2"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:37 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:37 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Creating event network-vif-unplugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:28:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Creating event network-vif-plugged:f2b23249-b032-47f5-973e-922f210b40b2 for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 on user Apr 12 06:28:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034781 Apr 12 06:28:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 120/361] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:40 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'services' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:28:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments/d96a84d2-2151-4f60-a72b-25e84b80c975" status: 202 len: 0 microversion: 2.1 time: 0.190954 Apr 12 06:28:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 122/362] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:28:40 2023] DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments/d96a84d2-2151-4f60-a72b-25e84b80c975 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f0ef557d-7192-437c-96f3-cc64aee0a5b4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Apr 12 06:28:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 121/363] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:28:40 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-623575fe-ae54-4309-94ce-b3611a602729 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044064 Apr 12 06:28:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 121/364] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:28:41 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:28:41 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Creating event network-changed:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:28:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032872 Apr 12 06:28:41 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 122/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:41 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:28:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" status: 204 len: 0 microversion: 2.1 time: 0.144864 Apr 12 06:28:41 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:28:41 2023] DELETE /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:42 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:28:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-b414547f-e0ab-45fc-87cb-881f8e7ed78c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" status: 200 len: 1662 microversion: 2.1 time: 0.227282 Apr 12 06:28:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 122/367] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:41 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => generated 1662 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:28:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "name": "network-vif-unplugged", "status": "completed", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Creating event network-vif-unplugged:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:28:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033325 Apr 12 06:28:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 123/368] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "name": "network-vif-deleted", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] Creating event network-vif-deleted:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:28:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027671 Apr 12 06:28:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf", "name": "network-vif-plugged", "status": "completed", "tag": "491bd5ef-7e10-49f3-ae6e-3804489ade6f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Creating event network-vif-plugged:491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf on user Apr 12 06:28:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Apr 12 06:28:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 123/370] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-06f164fb-392a-443e-b0f2-59dac824cef1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.091045 Apr 12 06:28:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 124/371] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:28:44 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] HTTP exception thrown: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. Apr 12 06:28:45 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Request method failure captured: Apr 12 06:28:45 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1 HTTP/1.1 Apr 12 06:28:45 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:28:45 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:28:45 user devstack@n-api.service[62040]: Connection: close Apr 12 06:28:45 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:28:45 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:28:45 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:28:45 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:28:45 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk70amRV7wktteHiOvKnOimN4YmuQbQCt6RHjlNU3h76VMUXoAz-SBADWPxkpizabKfHJzH0_IvLdaCkrzLgHpO4FddpSVFsrDhz9-M73SkbAQeyoyEw8_JK_Jpg-kQopptYki-y18I2n_mRjX8BHUQTA_KIr8bqU037l-50X7L95UM Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Project-Id: d92928c7a0ed463bbd9020808578b263 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesActionsTest-190731565 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d92928c7a0ed463bbd9020808578b263"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d92928c7a0ed463bbd9020808578b263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d92928c7a0ed463bbd9020808578b263"}]}] Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesActionsTest-190731565 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Tenant-Id: d92928c7a0ed463bbd9020808578b263 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesActionsTest-190731565 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-User: tempest-VolumesActionsTest-190731565-project-member Apr 12 06:28:45 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:28:45 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:28:45 user devstack@n-api.service[62040]: X-User-Id: 13f5402fd38f40c08c30991ad78b7f58 Apr 12 06:28:45 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesActionsTest-190731565-project-member Apr 12 06:28:45 user devstack@n-api.service[62040]: method: > Apr 12 06:28:45 user devstack@n-api.service[62040]: exception: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. Apr 12 06:28:45 user devstack@n-api.service[62040]: action_args: {'id': '0a0f5f93-3d0f-483c-b467-63b83db9cce1'} Apr 12 06:28:45 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. Apr 12 06:28:45 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:45 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Returning 404 to user: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:28:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f3afc176-4018-49a2-8fd9-02a5e5b88460 tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1" status: 404 len: 111 microversion: 2.1 time: 0.031406 Apr 12 06:28:45 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:28:44 2023] GET /compute/v2.1/servers/0a0f5f93-3d0f-483c-b467-63b83db9cce1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:28:45 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Creating event network-changed:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:28:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039940 Apr 12 06:28:45 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 124/373] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383010 Apr 12 06:28:47 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:28:46 2023] POST /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:28:54 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "311637d4-30b8-4ee9-9edc-6e58c10789b1"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] HTTP exception thrown: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Request method failure captured: Apr 12 06:28:55 user devstack@n-api.service[62040]: request: PUT /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments/fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 HTTP/1.1 Apr 12 06:28:55 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:28:55 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:28:55 user devstack@n-api.service[62040]: Connection: close Apr 12 06:28:55 user devstack@n-api.service[62040]: Content-Length: 74 Apr 12 06:28:55 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:28:55 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:28:55 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:28:55 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk8r_JumUOdl0y22ZUvWGphRDXbPIVNb4BlLdQXT9gjW20GhZaUH5SiPuZWdCNeUhFvF7kIFViAJTz5lmfIXoXWLRSZWrrP-DRYYH-egpFt0qftEmP6Xhp12F41udVSD8bZWXMg40YiuJTTlt8at-mPYnyfjyX6NH_zrDGwL4Awkg2g Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Project-Id: 0d2cfdceecb04b5cbe3f85062e041ba8 Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesAdminNegativeTest-1312782474 Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Role: admin,member,reader Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Roles: admin,member,reader Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d2cfdceecb04b5cbe3f85062e041ba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d2cfdceecb04b5cbe3f85062e041ba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d2cfdceecb04b5cbe3f85062e041ba8"}]}] Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesAdminNegativeTest-1312782474 Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Tenant-Id: 0d2cfdceecb04b5cbe3f85062e041ba8 Apr 12 06:28:55 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1312782474 Apr 12 06:28:55 user devstack@n-api.service[62040]: X-User: tempest-VolumesAdminNegativeTest-1312782474-project-admin Apr 12 06:28:55 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:28:55 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:28:55 user devstack@n-api.service[62040]: X-User-Id: 45156a4806af4850b2fc5652b423446f Apr 12 06:28:55 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesAdminNegativeTest-1312782474-project-admin Apr 12 06:28:55 user devstack@n-api.service[62040]: Apr 12 06:28:55 user devstack@n-api.service[62040]: {"volumeAttachment": {"volumeId": "311637d4-30b8-4ee9-9edc-6e58c10789b1"}} Apr 12 06:28:55 user devstack@n-api.service[62040]: method: > Apr 12 06:28:55 user devstack@n-api.service[62040]: exception: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. Apr 12 06:28:55 user devstack@n-api.service[62040]: action_args: {'server_id': 'd78558e6-437e-44dd-b6b4-123ed3447094', 'id': 'fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'body': {'volumeAttachment': {'volumeId': '311637d4-30b8-4ee9-9edc-6e58c10789b1'}}} Apr 12 06:28:55 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. (HTTP 404) (Request-ID: req-8fa6ce82-f540-4ee0-b476-fe846add08b6) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. Apr 12 06:28:55 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:28:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Returning 400 to user: Volume 311637d4-30b8-4ee9-9edc-6e58c10789b1 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:28:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6681441e-ac37-4115-90b9-ee03ded0fe4d tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments/fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5" status: 400 len: 107 microversion: 2.1 time: 0.326081 Apr 12 06:28:55 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 126/375] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 06:28:54 2023] PUT /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments/fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 => generated 107 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:28:55 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'services' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:28:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments/fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5" status: 202 len: 0 microversion: 2.1 time: 0.188574 Apr 12 06:28:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:28:55 2023] DELETE /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments/fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:28:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:28:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6e3b3c49-9837-4e78-991d-6cb9e47684b1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Apr 12 06:28:55 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 126/377] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:28:55 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1598595924", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] validate_networks() for [('f297c8e7-b3ac-4aa8-9a82-58dc197846a8', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Getting quotas for project 4d0a755743544f7c97644faad13bdeb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Getting quotas for user 67fbba4b2bbc4bb3b2255ef1facd7442 and project 4d0a755743544f7c97644faad13bdeb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:29:10 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:29:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.550607 Apr 12 06:29:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 127/378] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:29:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:29:10 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:10 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9ccf589b-f65a-49e7-ada4-c20446ef5e51 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:10 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-9ccf589b-f65a-49e7-ada4-c20446ef5e51 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:10 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-9ccf589b-f65a-49e7-ada4-c20446ef5e51 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9ccf589b-f65a-49e7-ada4-c20446ef5e51 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34" status: 200 len: 1208 microversion: 2.1 time: 0.086352 Apr 12 06:29:10 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 126/379] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:10 2023] GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34 => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f3cd11ce-773b-44bb-82ae-d276f9ac8773 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1695483936", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4f2549ed-915f-4494-87f3-9269834fa9da", "destination_type": "local"}, {"source_type": "volume", "uuid": "55ee740a-2e2d-4d68-a7b5-964a0f53ea4d", "destination_type": "invalid"}], "networks": [{"uuid": "c388c547-af8b-4a08-a268-43eb751fa0c1"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f3cd11ce-773b-44bb-82ae-d276f9ac8773 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Request method failure captured: Apr 12 06:29:12 user devstack@n-api.service[62041]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 06:29:12 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:29:12 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:29:12 user devstack@n-api.service[62041]: Connection: close Apr 12 06:29:12 user devstack@n-api.service[62041]: Content-Length: 494 Apr 12 06:29:12 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:29:12 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:29:12 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:29:12 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3toJs0XnKzJ3t3HYlTe5pTa7lFGnpTpzz0-uCRFnIBY7nyVdsp0LbwGy6E4zv_mRQ00byIQNRmiEZsxEcXmEgn2-PLwcC3mzLzRxiefRFpnIfB7kw8VyjSnBu5RIXv-Rjv5-ZtOWwLA_vwC-VtuotNEZSf4FsVwpyDxX3DF0T7X-c Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Project-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}] Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Tenant: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Tenant-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:29:12 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:29:12 user devstack@n-api.service[62041]: X-User: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:29:12 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:29:12 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:29:12 user devstack@n-api.service[62041]: X-User-Id: e761442395d14d7f82216e3d4174e43a Apr 12 06:29:12 user devstack@n-api.service[62041]: X-User-Name: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:29:12 user devstack@n-api.service[62041]: Apr 12 06:29:12 user devstack@n-api.service[62041]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1695483936", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4f2549ed-915f-4494-87f3-9269834fa9da", "destination_type": "local"}, {"source_type": "volume", "uuid": "55ee740a-2e2d-4d68-a7b5-964a0f53ea4d", "destination_type": "invalid"}], "networks": [{"uuid": "c388c547-af8b-4a08-a268-43eb751fa0c1"}]}} Apr 12 06:29:12 user devstack@n-api.service[62041]: method: > Apr 12 06:29:12 user devstack@n-api.service[62041]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 06:29:12 user devstack@n-api.service[62041]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1695483936', 'imageRef': '4f2549ed-915f-4494-87f3-9269834fa9da', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '4f2549ed-915f-4494-87f3-9269834fa9da', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '55ee740a-2e2d-4d68-a7b5-964a0f53ea4d', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c388c547-af8b-4a08-a268-43eb751fa0c1'}]}}} Apr 12 06:29:12 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise error Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 06:29:12 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f3cd11ce-773b-44bb-82ae-d276f9ac8773 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:29:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f3cd11ce-773b-44bb-82ae-d276f9ac8773 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010249 Apr 12 06:29:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 127/380] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:29:12 2023] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:13 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2b66d550-8a72-40f4-9bbe-b75dadaaf14c tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1494 microversion: 2.1 time: 0.153079 Apr 12 06:29:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 128/381] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:12 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1494 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:13 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35495bca-759b-4940-af0e-e6da34c73b34", "tag": "c690dd1f-30e2-4a1b-983a-5089b2f351bd"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Creating event network-changed:c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance 35495bca-759b-4940-af0e-e6da34c73b34 on user Apr 12 06:29:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 Apr 12 06:29:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35495bca-759b-4940-af0e-e6da34c73b34", "name": "network-vif-plugged", "status": "completed", "tag": "c690dd1f-30e2-4a1b-983a-5089b2f351bd"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Creating event network-vif-plugged:c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance 35495bca-759b-4940-af0e-e6da34c73b34 on user Apr 12 06:29:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043336 Apr 12 06:29:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35495bca-759b-4940-af0e-e6da34c73b34", "name": "network-vif-plugged", "status": "completed", "tag": "c690dd1f-30e2-4a1b-983a-5089b2f351bd"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Creating event network-vif-plugged:c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance 35495bca-759b-4940-af0e-e6da34c73b34 on user Apr 12 06:29:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Apr 12 06:29:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 129/384] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:17 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-51f1bb24-6852-4e8b-a74a-cd6d72cd5dba tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 200 len: 1502 microversion: 2.1 time: 0.152050 Apr 12 06:29:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:17 2023] GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2071604680", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "c152f4eb-1dbe-4252-b242-3f911e389655"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:19 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] validate_networks() for [('c152f4eb-1dbe-4252-b242-3f911e389655', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for user 2e5e4455358643b8830ce8c96aad5aad and project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:29:20 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:29:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.879377 Apr 12 06:29:20 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 129/386] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:29:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f39735ac-0d13-4de0-9029-7413e72142af tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f39735ac-0d13-4de0-9029-7413e72142af tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-f39735ac-0d13-4de0-9029-7413e72142af tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-f39735ac-0d13-4de0-9029-7413e72142af tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:20 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-f39735ac-0d13-4de0-9029-7413e72142af tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f39735ac-0d13-4de0-9029-7413e72142af tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1395 microversion: 2.87 time: 0.080167 Apr 12 06:29:20 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 130/387] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:29:20 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:29:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Creating event network-changed:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:29:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034999 Apr 12 06:29:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:24 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Going to try to start instance {{(pid=62041) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 06:29:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action" status: 202 len: 0 microversion: 2.1 time: 0.094359 Apr 12 06:29:24 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 130/389] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:29:24 2023] POST /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:24 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-117eb799-5fb5-4e33-a490-4b9484e1222f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1651 microversion: 2.1 time: 0.226961 Apr 12 06:29:24 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:24 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1651 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:25 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] HTTP exception thrown: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Request method failure captured: Apr 12 06:29:25 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 HTTP/1.1 Apr 12 06:29:25 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:29:25 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:29:25 user devstack@n-api.service[62042]: Connection: close Apr 12 06:29:25 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:29:25 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:29:25 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:29:25 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:29:25 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk425pMz6O0G20OXz58G7SlD8F5lePTlEV7kTugkwX2jkCI1Yx9flIcDC5aF3jClJe_ncZaWU8wmwhCKUMFFtC12h1ejyj0E8GwBunlctJRf25mnadSXFLWjM-G3ND3bfa9_u5bt8lfpkue2OIMuGjvYYBhQ0bKzTAHcoWmVlpA3-Pc Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Project-Id: c7742afa38eb46818efaf3b811c417ba Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestShelveInstance-735091148 Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7742afa38eb46818efaf3b811c417ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c7742afa38eb46818efaf3b811c417ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7742afa38eb46818efaf3b811c417ba"}]}] Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Tenant: tempest-TestShelveInstance-735091148 Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Tenant-Id: c7742afa38eb46818efaf3b811c417ba Apr 12 06:29:25 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestShelveInstance-735091148 Apr 12 06:29:25 user devstack@n-api.service[62042]: X-User: tempest-TestShelveInstance-735091148-project-member Apr 12 06:29:25 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:29:25 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:29:25 user devstack@n-api.service[62042]: X-User-Id: 9ed3a446901644b6a622afb3166f08dc Apr 12 06:29:25 user devstack@n-api.service[62042]: X-User-Name: tempest-TestShelveInstance-735091148-project-member Apr 12 06:29:25 user devstack@n-api.service[62042]: method: > Apr 12 06:29:25 user devstack@n-api.service[62042]: exception: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. Apr 12 06:29:25 user devstack@n-api.service[62042]: action_args: {'id': '7141c80d-34a9-40cc-a792-b01ffd9155b6'} Apr 12 06:29:25 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. Apr 12 06:29:25 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:29:25 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Returning 404 to user: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:29:25 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-bc3d65c7-2413-4127-b8f3-019fb9354021 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6" status: 404 len: 111 microversion: 2.1 time: 0.034416 Apr 12 06:29:25 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:25 2023] GET /compute/v2.1/servers/7141c80d-34a9-40cc-a792-b01ffd9155b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:29:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8dea3f6d-b768-47bd-a6f3-ab0d96e5d9e6 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Calling method '.version_select at 0x7fd24dc48ee0>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8dea3f6d-b768-47bd-a6f3-ab0d96e5d9e6 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1634672150" status: 202 len: 0 microversion: 2.1 time: 0.031162 Apr 12 06:29:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 06:29:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1634672150 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:29:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:29:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051434 Apr 12 06:29:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:29:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031800 Apr 12 06:29:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 131/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e4f5a3ad-121b-4b24-8655-0f9339d4aa65 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050815 Apr 12 06:29:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 132/395] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:29:30 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:30 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c9af931c-a69e-47ea-bcca-a756ee3b876e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1677 microversion: 2.1 time: 0.310590 Apr 12 06:29:30 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 133/396] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:30 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1677 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:30 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:31 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-632fd8b8-65d1-47d2-8fbf-5d789fc0e99b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1677 microversion: 2.1 time: 0.297038 Apr 12 06:29:31 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:30 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:31 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8e3daed8-c9ff-4cec-9edd-4a8eb764088f tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1677 microversion: 2.1 time: 0.192226 Apr 12 06:29:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:31 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] HTTP exception thrown: Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf could not be found. Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Request method failure captured: Apr 12 06:29:32 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf HTTP/1.1 Apr 12 06:29:32 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:29:32 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:29:32 user devstack@n-api.service[62040]: Connection: close Apr 12 06:29:32 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:29:32 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:29:32 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:29:32 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:29:32 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk4iZlV3O14C-M59XVbFQW9FD2mD6f-J1DiAqtce9VJ_gcpCusWFm5tLZeVrg9O2-vTq-w42oEnLDTdlfP2DX_4qjVsEwugdCCTTwOpQFfBTkcnHkrNuZiq8--hppYBUCEC3r8knjDEQbnURrdtxUKdWUzbpMzIh4G9gqprFkq1fKjM Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Project-Id: 5a7d74130d4d417a93de352381229948 Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestStampPattern-1782553765 Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a7d74130d4d417a93de352381229948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5a7d74130d4d417a93de352381229948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a7d74130d4d417a93de352381229948"}]}] Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Tenant: tempest-TestStampPattern-1782553765 Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Tenant-Id: 5a7d74130d4d417a93de352381229948 Apr 12 06:29:32 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestStampPattern-1782553765 Apr 12 06:29:32 user devstack@n-api.service[62040]: X-User: tempest-TestStampPattern-1782553765-project-member Apr 12 06:29:32 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:29:32 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:29:32 user devstack@n-api.service[62040]: X-User-Id: d59314e79d0344a2943391c3c2ab628a Apr 12 06:29:32 user devstack@n-api.service[62040]: X-User-Name: tempest-TestStampPattern-1782553765-project-member Apr 12 06:29:32 user devstack@n-api.service[62040]: method: > Apr 12 06:29:32 user devstack@n-api.service[62040]: exception: Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf could not be found. Apr 12 06:29:32 user devstack@n-api.service[62040]: action_args: {'id': 'adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf'} Apr 12 06:29:32 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf could not be found. Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf could not be found. Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf could not be found. Apr 12 06:29:32 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:29:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Returning 404 to user: Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:29:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1738a750-9dac-49b2-969c-8397b1581b0e tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" status: 404 len: 111 microversion: 2.1 time: 0.053387 Apr 12 06:29:32 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:32 2023] GET /compute/v2.1/servers/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:29:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:29:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037291 Apr 12 06:29:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] HTTP exception thrown: Instance a528e600-7358-4b92-9b71-12759f405b38 is not attached to volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Request method failure captured: Apr 12 06:29:36 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments/7b336ad6-910c-4dd4-8ef4-c16d440e9881 HTTP/1.1 Apr 12 06:29:36 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:29:36 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:29:36 user devstack@n-api.service[62041]: Connection: close Apr 12 06:29:36 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:29:36 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:29:36 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:29:36 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:29:36 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk4iZlV3O14C-M59XVbFQW9FD2mD6f-J1DiAqtce9VJ_gcpCusWFm5tLZeVrg9O2-vTq-w42oEnLDTdlfP2DX_4qjVsEwugdCCTTwOpQFfBTkcnHkrNuZiq8--hppYBUCEC3r8knjDEQbnURrdtxUKdWUzbpMzIh4G9gqprFkq1fKjM Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Project-Id: 5a7d74130d4d417a93de352381229948 Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Project-Name: tempest-TestStampPattern-1782553765 Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a7d74130d4d417a93de352381229948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5a7d74130d4d417a93de352381229948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a7d74130d4d417a93de352381229948"}]}] Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Tenant: tempest-TestStampPattern-1782553765 Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Tenant-Id: 5a7d74130d4d417a93de352381229948 Apr 12 06:29:36 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TestStampPattern-1782553765 Apr 12 06:29:36 user devstack@n-api.service[62041]: X-User: tempest-TestStampPattern-1782553765-project-member Apr 12 06:29:36 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:29:36 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:29:36 user devstack@n-api.service[62041]: X-User-Id: d59314e79d0344a2943391c3c2ab628a Apr 12 06:29:36 user devstack@n-api.service[62041]: X-User-Name: tempest-TestStampPattern-1782553765-project-member Apr 12 06:29:36 user devstack@n-api.service[62041]: method: > Apr 12 06:29:36 user devstack@n-api.service[62041]: exception: Instance a528e600-7358-4b92-9b71-12759f405b38 is not attached to volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 Apr 12 06:29:36 user devstack@n-api.service[62041]: action_args: {'server_id': 'a528e600-7358-4b92-9b71-12759f405b38', 'id': '7b336ad6-910c-4dd4-8ef4-c16d440e9881'} Apr 12 06:29:36 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7b336ad6-910c-4dd4-8ef4-c16d440e9881. Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a528e600-7358-4b92-9b71-12759f405b38 is not attached to volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a528e600-7358-4b92-9b71-12759f405b38 is not attached to volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 Apr 12 06:29:36 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:29:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Returning 404 to user: Instance a528e600-7358-4b92-9b71-12759f405b38 is not attached to volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:29:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-484e9d5d-f7cb-4a9b-b7e5-52a4b6f206a6 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments/7b336ad6-910c-4dd4-8ef4-c16d440e9881" status: 404 len: 154 microversion: 2.1 time: 0.114930 Apr 12 06:29:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:29:36 2023] DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38/os-volume_attachments/7b336ad6-910c-4dd4-8ef4-c16d440e9881 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:29:37 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:29:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043387 Apr 12 06:29:37 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:37 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:29:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38" status: 204 len: 0 microversion: 2.1 time: 0.113886 Apr 12 06:29:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 134/403] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:29:37 2023] DELETE /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:38 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-eb1c3e5e-e619-41d4-9eca-7facf9c8b5cf tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38" status: 200 len: 1664 microversion: 2.1 time: 0.221941 Apr 12 06:29:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:37 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 => generated 1664 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "name": "network-vif-unplugged", "status": "completed", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Creating event network-vif-unplugged:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:29:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032697 Apr 12 06:29:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 136/405] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:39 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Creating event network-changed:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:29:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033211 Apr 12 06:29:39 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 135/406] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "name": "network-vif-deleted", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] Creating event network-vif-deleted:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:29:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Apr 12 06:29:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a528e600-7358-4b92-9b71-12759f405b38", "name": "network-vif-plugged", "status": "completed", "tag": "039ecba8-673d-41c4-a5bd-f5671896c181"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=31 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Creating event network-vif-plugged:039ecba8-673d-41c4-a5bd-f5671896c181 for instance a528e600-7358-4b92-9b71-12759f405b38 on user Apr 12 06:29:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045619 Apr 12 06:29:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:45 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3fbd4b31-97b3-456a-8751-ad68a689eef8 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051313 Apr 12 06:29:45 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 136/409] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:29:45 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:29:45 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-872207444", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:45 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:45 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] validate_networks() for [('dcf0c385-b3ea-4b92-8d8d-a0e1243f6189', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting quotas for project 0b656fa0bf05484889563c50ccc9a7e9. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting quotas for user d682efe6338b4989beb714cce25e8e31 and project 0b656fa0bf05484889563c50ccc9a7e9. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:29:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:29:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.488271 Apr 12 06:29:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 137/410] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:29:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:29:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-aae8bdee-41cc-408d-b516-0f2e864836d1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:29:46 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-aae8bdee-41cc-408d-b516-0f2e864836d1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:29:46 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-aae8bdee-41cc-408d-b516-0f2e864836d1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:29:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-aae8bdee-41cc-408d-b516-0f2e864836d1 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1" status: 200 len: 1211 microversion: 2.1 time: 0.075506 Apr 12 06:29:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 138/411] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:29:46 2023] GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1 => generated 1211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:29:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11dc4450-74e9-48ab-9de3-024baa6af9f1", "tag": "3abeb81f-8a9b-40c6-a526-7a10818160b0"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Creating event network-changed:3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 on user Apr 12 06:29:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032186 Apr 12 06:29:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 137/412] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:51 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc4450-74e9-48ab-9de3-024baa6af9f1", "name": "network-vif-plugged", "status": "completed", "tag": "3abeb81f-8a9b-40c6-a526-7a10818160b0"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:51 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Creating event network-vif-plugged:3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 on user Apr 12 06:29:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043036 Apr 12 06:29:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:29:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc4450-74e9-48ab-9de3-024baa6af9f1", "name": "network-vif-plugged", "status": "completed", "tag": "3abeb81f-8a9b-40c6-a526-7a10818160b0"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:29:53 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:29:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:29:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:29:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:29:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Creating event network-vif-plugged:3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 on user Apr 12 06:29:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033593 Apr 12 06:29:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 139/414] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=7 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:00 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-115ed38a-0bd3-43ad-9a49-73c6d7ee97ef tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34" status: 200 len: 1486 microversion: 2.1 time: 0.154076 Apr 12 06:30:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 138/415] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:00 2023] GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34 => generated 1486 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:11 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:11 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:11 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e56f0231-d08b-4439-9b4b-71ab68beb594 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1770 microversion: 2.87 time: 0.232805 Apr 12 06:30:11 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 139/416] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:30:10 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1770 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=7 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:15 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-14e09856-e098-4dc1-9bd6-3b9c73523acd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1655 microversion: 2.1 time: 0.187504 Apr 12 06:30:15 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 140/417] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:14 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1655 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] HTTP exception thrown: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Request method failure captured: Apr 12 06:30:17 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 HTTP/1.1 Apr 12 06:30:17 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:30:17 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:30:17 user devstack@n-api.service[62042]: Connection: close Apr 12 06:30:17 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:30:17 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:30:17 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:30:17 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:30:17 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk3toJs0XnKzJ3t3HYlTe5pTa7lFGnpTpzz0-uCRFnIBY7nyVdsp0LbwGy6E4zv_mRQ00byIQNRmiEZsxEcXmEgn2-PLwcC3mzLzRxiefRFpnIfB7kw8VyjSnBu5RIXv-Rjv5-ZtOWwLA_vwC-VtuotNEZSf4FsVwpyDxX3DF0T7X-c Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Project-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}] Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Tenant: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Tenant-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:30:17 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:30:17 user devstack@n-api.service[62042]: X-User: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:30:17 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:30:17 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:30:17 user devstack@n-api.service[62042]: X-User-Id: e761442395d14d7f82216e3d4174e43a Apr 12 06:30:17 user devstack@n-api.service[62042]: X-User-Name: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:30:17 user devstack@n-api.service[62042]: method: > Apr 12 06:30:17 user devstack@n-api.service[62042]: exception: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62042]: action_args: {'id': '2a24ff32-6994-4754-be34-7664bbe21d16'} Apr 12 06:30:17 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Returning 404 to user: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:30:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-818796e4-7097-474c-9b46-72a58c1d69fc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 404 len: 111 microversion: 2.1 time: 0.031631 Apr 12 06:30:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:30:17 2023] DELETE /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] HTTP exception thrown: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Request method failure captured: Apr 12 06:30:17 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 HTTP/1.1 Apr 12 06:30:17 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:30:17 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:30:17 user devstack@n-api.service[62041]: Connection: close Apr 12 06:30:17 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:30:17 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:30:17 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:30:17 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:30:17 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3toJs0XnKzJ3t3HYlTe5pTa7lFGnpTpzz0-uCRFnIBY7nyVdsp0LbwGy6E4zv_mRQ00byIQNRmiEZsxEcXmEgn2-PLwcC3mzLzRxiefRFpnIfB7kw8VyjSnBu5RIXv-Rjv5-ZtOWwLA_vwC-VtuotNEZSf4FsVwpyDxX3DF0T7X-c Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Project-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}] Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Tenant: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Tenant-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:30:17 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:30:17 user devstack@n-api.service[62041]: X-User: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:30:17 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:30:17 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:30:17 user devstack@n-api.service[62041]: X-User-Id: e761442395d14d7f82216e3d4174e43a Apr 12 06:30:17 user devstack@n-api.service[62041]: X-User-Name: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:30:17 user devstack@n-api.service[62041]: method: > Apr 12 06:30:17 user devstack@n-api.service[62041]: exception: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62041]: action_args: {'id': '2a24ff32-6994-4754-be34-7664bbe21d16'} Apr 12 06:30:17 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. Apr 12 06:30:17 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Returning 404 to user: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:30:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3d8ac358-de10-41f1-b3e1-d9bcafa8ee4f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16" status: 404 len: 111 microversion: 2.1 time: 0.029974 Apr 12 06:30:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:17 2023] GET /compute/v2.1/servers/2a24ff32-6994-4754-be34-7664bbe21d16 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:30:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:30:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e/action" status: 200 len: 32 microversion: 2.1 time: 0.113840 Apr 12 06:30:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 141/420] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:30:17 2023] POST /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 204 len: 0 microversion: 2.1 time: 0.115239 Apr 12 06:30:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:30:17 2023] DELETE /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:17 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9b2428d3-954b-4c99-954c-bfa1c4aca05d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 200 len: 1508 microversion: 2.1 time: 0.257241 Apr 12 06:30:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:17 2023] GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b32f3f-86c4-450a-a710-7d0c05ea4097", "name": "network-vif-unplugged", "status": "completed", "tag": "33f085d7-b843-4c48-8379-a5c2690a4231"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Creating event network-vif-unplugged:33f085d7-b843-4c48-8379-a5c2690a4231 for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 on user Apr 12 06:30:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033936 Apr 12 06:30:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 141/423] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:18 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1b610be6-81cd-438b-8ec0-a3c72ecddffc tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 200 len: 1500 microversion: 2.1 time: 0.405881 Apr 12 06:30:18 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:17 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 1500 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-unplugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Creating event network-vif-unplugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:30:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028179 Apr 12 06:30:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 142/425] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:20 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b32f3f-86c4-450a-a710-7d0c05ea4097", "name": "network-vif-plugged", "status": "completed", "tag": "33f085d7-b843-4c48-8379-a5c2690a4231"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Creating event network-vif-plugged:33f085d7-b843-4c48-8379-a5c2690a4231 for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 on user Apr 12 06:30:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029367 Apr 12 06:30:20 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 142/426] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-plugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}, {"server_uuid": "46b32f3f-86c4-450a-a710-7d0c05ea4097", "name": "network-vif-deleted", "tag": "33f085d7-b843-4c48-8379-a5c2690a4231"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Creating event network-vif-plugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:30:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Creating event network-vif-deleted:33f085d7-b843-4c48-8379-a5c2690a4231 for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 on user Apr 12 06:30:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044536 Apr 12 06:30:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 143/427] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-plugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}, {"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-plugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Creating event network-vif-plugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:30:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Creating event network-vif-plugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:30:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038673 Apr 12 06:30:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 143/428] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] HTTP exception thrown: Instance a528e600-7358-4b92-9b71-12759f405b38 could not be found. Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Request method failure captured: Apr 12 06:30:28 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 HTTP/1.1 Apr 12 06:30:28 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:30:28 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:30:28 user devstack@n-api.service[62042]: Connection: close Apr 12 06:30:28 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:30:28 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:30:28 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:30:28 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:30:28 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk4iZlV3O14C-M59XVbFQW9FD2mD6f-J1DiAqtce9VJ_gcpCusWFm5tLZeVrg9O2-vTq-w42oEnLDTdlfP2DX_4qjVsEwugdCCTTwOpQFfBTkcnHkrNuZiq8--hppYBUCEC3r8knjDEQbnURrdtxUKdWUzbpMzIh4G9gqprFkq1fKjM Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Project-Id: 5a7d74130d4d417a93de352381229948 Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestStampPattern-1782553765 Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a7d74130d4d417a93de352381229948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5a7d74130d4d417a93de352381229948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a7d74130d4d417a93de352381229948"}]}] Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Tenant: tempest-TestStampPattern-1782553765 Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Tenant-Id: 5a7d74130d4d417a93de352381229948 Apr 12 06:30:28 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestStampPattern-1782553765 Apr 12 06:30:28 user devstack@n-api.service[62042]: X-User: tempest-TestStampPattern-1782553765-project-member Apr 12 06:30:28 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:30:28 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:30:28 user devstack@n-api.service[62042]: X-User-Id: d59314e79d0344a2943391c3c2ab628a Apr 12 06:30:28 user devstack@n-api.service[62042]: X-User-Name: tempest-TestStampPattern-1782553765-project-member Apr 12 06:30:28 user devstack@n-api.service[62042]: method: > Apr 12 06:30:28 user devstack@n-api.service[62042]: exception: Instance a528e600-7358-4b92-9b71-12759f405b38 could not be found. Apr 12 06:30:28 user devstack@n-api.service[62042]: action_args: {'id': 'a528e600-7358-4b92-9b71-12759f405b38'} Apr 12 06:30:28 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a528e600-7358-4b92-9b71-12759f405b38 could not be found. Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a528e600-7358-4b92-9b71-12759f405b38 could not be found. Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a528e600-7358-4b92-9b71-12759f405b38 could not be found. Apr 12 06:30:28 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:30:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Returning 404 to user: Instance a528e600-7358-4b92-9b71-12759f405b38 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:30:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-fc3a270d-a16c-4487-a366-4cd734506763 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38" status: 404 len: 111 microversion: 2.1 time: 0.029315 Apr 12 06:30:28 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:28 2023] GET /compute/v2.1/servers/a528e600-7358-4b92-9b71-12759f405b38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:30:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4dc60fee-b259-4255-9bb0-707db5a6f472 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Calling method '.version_select at 0x7fd24dcd9fc0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4dc60fee-b259-4255-9bb0-707db5a6f472 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1405244377" status: 202 len: 0 microversion: 2.1 time: 0.027118 Apr 12 06:30:30 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:30:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1405244377 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:33 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f92ef5d0-78bc-4cc3-bc85-7e691973c840 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1677 microversion: 2.1 time: 0.163150 Apr 12 06:30:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 144/431] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:32 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:33 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349839 Apr 12 06:30:33 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 144/432] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:30:33 2023] POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4cf9b0b9-852f-4e6f-9c53-8ca943f3269a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Action: 'create', calling method: .version_select at 0x7fd24dee0670>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-2112427330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcgEQFNhIVnT0wxBESUjSnWt8fLNeSczeXi75jsZIJIsHDY3ZCw0iL7p7oChBDAewN3LU2kaBsEIsgV6dzIxe4HbSqe0jpOsMXcUoleoH69sicZfwxhtmAiR7pt/liSYQ=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:33 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-4cf9b0b9-852f-4e6f-9c53-8ca943f3269a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting quotas for project 1ebdd9f4006d413686bba37f22374759. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:30:33 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-4cf9b0b9-852f-4e6f-9c53-8ca943f3269a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting quotas for user 549eaf8464b64c96ab3c6dde394cc31e and project 1ebdd9f4006d413686bba37f22374759. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:30:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4cf9b0b9-852f-4e6f-9c53-8ca943f3269a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.213256 Apr 12 06:30:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:30:33 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1794952988", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-2112427330", "security_groups": [{"name": "tempest-secgroup-smoke-1148484736"}], "networks": [{"uuid": "4d619acb-e553-4fd8-ab04-623325eaf182"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:35 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] validate_networks() for [('4d619acb-e553-4fd8-ab04-623325eaf182', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting quotas for project 1ebdd9f4006d413686bba37f22374759. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting quotas for user 549eaf8464b64c96ab3c6dde394cc31e and project 1ebdd9f4006d413686bba37f22374759. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:30:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:30:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.907923 Apr 12 06:30:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 145/434] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:30:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:30:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-96394208-3b17-4dc5-9af8-b487fafc4f57 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:36 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-96394208-3b17-4dc5-9af8-b487fafc4f57 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:36 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-96394208-3b17-4dc5-9af8-b487fafc4f57 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549eaf8464b64c96ab3c6dde394cc31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdd9f4006d413686bba37f22374759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-96394208-3b17-4dc5-9af8-b487fafc4f57 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2" status: 200 len: 1257 microversion: 2.1 time: 0.107191 Apr 12 06:30:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:36 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 => generated 1257 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:36 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-86277253-6913-44ce-923d-5830e6204414 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1" status: 200 len: 1493 microversion: 2.1 time: 0.174762 Apr 12 06:30:36 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:36 2023] GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1 => generated 1493 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:30:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Creating event network-changed:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:30:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032430 Apr 12 06:30:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 146/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Old instance type m1.nano, new instance type m1.micro {{(pid=62042) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:30:41 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:30:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/action" status: 202 len: 0 microversion: 2.1 time: 0.325230 Apr 12 06:30:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 146/438] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:30:41 2023] POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:30:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "name": "network-vif-plugged", "status": "completed", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=29 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Creating event network-vif-plugged:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:30:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053829 Apr 12 06:30:41 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:41 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:30:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7ef79a10-a4d3-413c-b848-5f7df823a55b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1732 microversion: 2.1 time: 0.214848 Apr 12 06:30:41 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 147/440] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:30:41 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:30:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "name": "network-vif-plugged", "status": "completed", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Creating event network-vif-plugged:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:30:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033690 Apr 12 06:30:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 147/441] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:44 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-unplugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Creating event network-vif-unplugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:30:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070806 Apr 12 06:30:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 148/442] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:30:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}, {"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}, {"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}, {"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-unplugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}, {"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Creating event network-vif-unplugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:30:46 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.050900 Apr 12 06:30:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:57 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:57 user devstack@n-api.service[62042]: DEBUG nova.compute.api [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:30:57 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058972 Apr 12 06:30:57 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 148/444] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:30:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:30:59 user devstack@n-api.service[62040]: DEBUG nova.compute.api [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:30:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043148 Apr 12 06:30:59 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:30:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=9 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:01 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:31:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34" status: 204 len: 0 microversion: 2.1 time: 0.129864 Apr 12 06:31:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 149/446] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:31:01 2023] DELETE /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:01 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:01 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-7bd77f5f-bb1f-4eb6-9197-a6bde0964677 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34" status: 200 len: 1492 microversion: 2.1 time: 0.182055 Apr 12 06:31:01 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 149/447] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:01 2023] GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34 => generated 1492 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:01 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35495bca-759b-4940-af0e-e6da34c73b34", "name": "network-vif-unplugged", "status": "completed", "tag": "c690dd1f-30e2-4a1b-983a-5089b2f351bd"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:01 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Creating event network-vif-unplugged:c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance 35495bca-759b-4940-af0e-e6da34c73b34 on user Apr 12 06:31:01 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049899 Apr 12 06:31:01 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:02 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35495bca-759b-4940-af0e-e6da34c73b34", "name": "network-vif-deleted", "tag": "c690dd1f-30e2-4a1b-983a-5089b2f351bd"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:02 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] Creating event network-vif-deleted:c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance 35495bca-759b-4940-af0e-e6da34c73b34 on user Apr 12 06:31:02 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043273 Apr 12 06:31:02 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:03 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35495bca-759b-4940-af0e-e6da34c73b34", "name": "network-vif-plugged", "status": "completed", "tag": "c690dd1f-30e2-4a1b-983a-5089b2f351bd"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:03 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Creating event network-vif-plugged:c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance 35495bca-759b-4940-af0e-e6da34c73b34 on user Apr 12 06:31:03 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034342 Apr 12 06:31:03 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 150/450] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:08 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] HTTP exception thrown: Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 could not be found. Apr 12 06:31:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b816bf14-6db7-497f-91a0-199c44a23210 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 200 len: 1488 microversion: 2.1 time: 0.207703 Apr 12 06:31:08 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:07 2023] GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 1488 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Request method failure captured: Apr 12 06:31:08 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 HTTP/1.1 Apr 12 06:31:08 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:31:08 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:31:08 user devstack@n-api.service[62041]: Connection: close Apr 12 06:31:08 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:31:08 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:31:08 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:31:08 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:31:08 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3toJs0XnKzJ3t3HYlTe5pTa7lFGnpTpzz0-uCRFnIBY7nyVdsp0LbwGy6E4zv_mRQ00byIQNRmiEZsxEcXmEgn2-PLwcC3mzLzRxiefRFpnIfB7kw8VyjSnBu5RIXv-Rjv5-ZtOWwLA_vwC-VtuotNEZSf4FsVwpyDxX3DF0T7X-c Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Project-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbca90b5b5fb49ca857aa4e215a99e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbca90b5b5fb49ca857aa4e215a99e37"}]}] Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Tenant: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Tenant-Id: fbca90b5b5fb49ca857aa4e215a99e37 Apr 12 06:31:08 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-815999574 Apr 12 06:31:08 user devstack@n-api.service[62041]: X-User: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:31:08 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:31:08 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:31:08 user devstack@n-api.service[62041]: X-User-Id: e761442395d14d7f82216e3d4174e43a Apr 12 06:31:08 user devstack@n-api.service[62041]: X-User-Name: tempest-ServersNegativeTestJSON-815999574-project-member Apr 12 06:31:08 user devstack@n-api.service[62041]: method: > Apr 12 06:31:08 user devstack@n-api.service[62041]: exception: Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 could not be found. Apr 12 06:31:08 user devstack@n-api.service[62041]: action_args: {'id': '46b32f3f-86c4-450a-a710-7d0c05ea4097'} Apr 12 06:31:08 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 could not be found. Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 could not be found. Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 could not be found. Apr 12 06:31:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:31:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Returning 404 to user: Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:31:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c1406b02-48e0-4877-b345-852a7aa39f8f tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097" status: 404 len: 111 microversion: 2.1 time: 0.030572 Apr 12 06:31:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:08 2023] GET /compute/v2.1/servers/46b32f3f-86c4-450a-a710-7d0c05ea4097 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "838e110f-042b-4725-8084-993da3d9f384"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:11 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'flavor' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:31:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/action" status: 200 len: 29 microversion: 2.87 time: 0.541961 Apr 12 06:31:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 151/453] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:31:11 2023] POST /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/action => generated 29 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:12 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-40197f71-7b71-4b46-b4f0-c990611263e9 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1776 microversion: 2.87 time: 0.177929 Apr 12 06:31:12 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 152/454] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:31:12 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1776 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:31:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-unplugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Creating event network-vif-unplugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:31:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028491 Apr 12 06:31:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:31:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039085 Apr 12 06:31:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 152/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-698a4c99-c391-43e8-bbbc-b82e8e4beb49 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049425 Apr 12 06:31:15 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 153/457] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:31:15 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:31:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 204 len: 0 microversion: 2.1 time: 0.112093 Apr 12 06:31:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 153/458] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:31:15 2023] DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:15 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-21259761-595c-494c-9b3c-458b15eb812e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 200 len: 1661 microversion: 2.1 time: 0.195151 Apr 12 06:31:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 153/459] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:15 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 1661 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-unplugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}, {"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-plugged", "status": "completed", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Creating event network-vif-unplugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:31:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Creating event network-vif-plugged:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:31:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036276 Apr 12 06:31:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 154/460] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee97a4-9497-43c2-a688-7bedd1441885", "name": "network-vif-deleted", "tag": "1e69d862-c01c-48c7-8795-00233f9e7812"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] Creating event network-vif-deleted:1e69d862-c01c-48c7-8795-00233f9e7812 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 on user Apr 12 06:31:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037652 Apr 12 06:31:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 154/461] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}, {"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:31:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:31:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037256 Apr 12 06:31:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 154/462] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b0efc223-2d96-43f7-8ae7-1b0ef706c1ac tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: .version_select at 0x7fd24dee2ef0>, body: {"keypair": {"name": "tempest-keypair-2104449008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLjxQ88AtZRhXkY0w8AIQaC2BkRU10aHemy0vGFQIJaHfdQnFw5jX788hQrmmL2cfXBPzOBR1uFgPc7i6axEKrPM67paZDd875f3qCLLPV1vMiFyxrryrbMz1BF5WwCng=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:19 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-b0efc223-2d96-43f7-8ae7-1b0ef706c1ac tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:31:19 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-b0efc223-2d96-43f7-8ae7-1b0ef706c1ac tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:31:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b0efc223-2d96-43f7-8ae7-1b0ef706c1ac tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155394 Apr 12 06:31:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 155/463] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:31:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2019489998", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "50460fb0-3b6e-4da6-890c-1777c1d64acc"}], "security_groups": [{"name": "tempest-securitygroup--775369682"}], "key_name": "tempest-keypair-2104449008", "user_data": "}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] validate_networks() for [('50460fb0-3b6e-4da6-890c-1777c1d64acc', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:31:21 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:31:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.522144 Apr 12 06:31:21 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 155/464] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:31:21 2023] POST /compute/v2.1/servers => generated 399 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:31:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c946a84b-cfd9-4ebd-b6aa-3bcf58053765 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:21 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c946a84b-cfd9-4ebd-b6aa-3bcf58053765 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:22 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c946a84b-cfd9-4ebd-b6aa-3bcf58053765 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c946a84b-cfd9-4ebd-b6aa-3bcf58053765 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 200 len: 1236 microversion: 2.1 time: 0.110562 Apr 12 06:31:22 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 155/465] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:21 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:25 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Creating event network-changed:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:31:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033081 Apr 12 06:31:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 156/466] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:26 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549eaf8464b64c96ab3c6dde394cc31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdd9f4006d413686bba37f22374759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2b3efed0-3a38-4f88-a94d-767f063fc4d7 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2" status: 200 len: 1568 microversion: 2.1 time: 0.200775 Apr 12 06:31:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 156/467] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:26 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "name": "network-vif-plugged", "status": "completed", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=19 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Creating event network-vif-plugged:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:31:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045575 Apr 12 06:31:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 156/468] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "name": "network-vif-plugged", "status": "completed", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=29 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Creating event network-vif-plugged:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:31:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Apr 12 06:31:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 157/469] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:31 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b15fd59e-fcbb-41b2-9ba5-9954a206a2d0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1731 microversion: 2.1 time: 0.159264 Apr 12 06:31:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 157/470] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:31 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3cd99089-1282-4efd-b9c6-7c2ee9c90a2a"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] HTTP exception thrown: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Request method failure captured: Apr 12 06:31:38 user devstack@n-api.service[62042]: request: PUT /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1/os-volume_attachments/708ac32b-0dd7-4aad-9f01-49f8469bd582 HTTP/1.1 Apr 12 06:31:38 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:31:38 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:31:38 user devstack@n-api.service[62042]: Connection: close Apr 12 06:31:38 user devstack@n-api.service[62042]: Content-Length: 74 Apr 12 06:31:38 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:31:38 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:31:38 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:31:38 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk8r_JumUOdl0y22ZUvWGphRDXbPIVNb4BlLdQXT9gjW20GhZaUH5SiPuZWdCNeUhFvF7kIFViAJTz5lmfIXoXWLRSZWrrP-DRYYH-egpFt0qftEmP6Xhp12F41udVSD8bZWXMg40YiuJTTlt8at-mPYnyfjyX6NH_zrDGwL4Awkg2g Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Project-Id: 0d2cfdceecb04b5cbe3f85062e041ba8 Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesAdminNegativeTest-1312782474 Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Role: admin,member,reader Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Roles: admin,member,reader Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d2cfdceecb04b5cbe3f85062e041ba8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d2cfdceecb04b5cbe3f85062e041ba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d2cfdceecb04b5cbe3f85062e041ba8"}]}] Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesAdminNegativeTest-1312782474 Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Tenant-Id: 0d2cfdceecb04b5cbe3f85062e041ba8 Apr 12 06:31:38 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1312782474 Apr 12 06:31:38 user devstack@n-api.service[62042]: X-User: tempest-VolumesAdminNegativeTest-1312782474-project-admin Apr 12 06:31:38 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:31:38 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:31:38 user devstack@n-api.service[62042]: X-User-Id: 45156a4806af4850b2fc5652b423446f Apr 12 06:31:38 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesAdminNegativeTest-1312782474-project-admin Apr 12 06:31:38 user devstack@n-api.service[62042]: Apr 12 06:31:38 user devstack@n-api.service[62042]: {"volumeAttachment": {"volumeId": "3cd99089-1282-4efd-b9c6-7c2ee9c90a2a"}} Apr 12 06:31:38 user devstack@n-api.service[62042]: method: > Apr 12 06:31:38 user devstack@n-api.service[62042]: exception: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. Apr 12 06:31:38 user devstack@n-api.service[62042]: action_args: {'server_id': '11dc4450-74e9-48ab-9de3-024baa6af9f1', 'id': '708ac32b-0dd7-4aad-9f01-49f8469bd582', 'body': {'volumeAttachment': {'volumeId': '3cd99089-1282-4efd-b9c6-7c2ee9c90a2a'}}} Apr 12 06:31:38 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. (HTTP 404) (Request-ID: req-a0c1491c-076d-47c9-a6fd-63d69edf82ec) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. Apr 12 06:31:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] Returning 404 to user: Volume 708ac32b-0dd7-4aad-9f01-49f8469bd582 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:31:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-dc7e8c54-eab7-4dc4-90ee-0fd15ca14ae0 tempest-VolumesAdminNegativeTest-1312782474 tempest-VolumesAdminNegativeTest-1312782474-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1/os-volume_attachments/708ac32b-0dd7-4aad-9f01-49f8469bd582" status: 404 len: 109 microversion: 2.1 time: 0.087912 Apr 12 06:31:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 157/471] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 06:31:38 2023] PUT /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1/os-volume_attachments/708ac32b-0dd7-4aad-9f01-49f8469bd582 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:40 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:31:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1" status: 204 len: 0 microversion: 2.1 time: 0.344585 Apr 12 06:31:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 158/472] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:31:40 2023] DELETE /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:40 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-5610f8bc-81d2-47f9-b102-676b53e6610e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1" status: 200 len: 1499 microversion: 2.1 time: 0.188933 Apr 12 06:31:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 158/473] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:40 2023] GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1 => generated 1499 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc4450-74e9-48ab-9de3-024baa6af9f1", "name": "network-vif-unplugged", "status": "completed", "tag": "3abeb81f-8a9b-40c6-a526-7a10818160b0"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Creating event network-vif-unplugged:3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 on user Apr 12 06:31:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030194 Apr 12 06:31:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 158/474] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc4450-74e9-48ab-9de3-024baa6af9f1", "name": "network-vif-deleted", "tag": "3abeb81f-8a9b-40c6-a526-7a10818160b0"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] Creating event network-vif-deleted:3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 on user Apr 12 06:31:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Apr 12 06:31:41 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 159/475] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc4450-74e9-48ab-9de3-024baa6af9f1", "name": "network-vif-plugged", "status": "completed", "tag": "3abeb81f-8a9b-40c6-a526-7a10818160b0"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Creating event network-vif-plugged:3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 on user Apr 12 06:31:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Apr 12 06:31:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 159/476] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] HTTP exception thrown: Instance 35495bca-759b-4940-af0e-e6da34c73b34 could not be found. Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Request method failure captured: Apr 12 06:31:51 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34 HTTP/1.1 Apr 12 06:31:51 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:31:51 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:31:51 user devstack@n-api.service[62042]: Connection: close Apr 12 06:31:51 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:31:51 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:31:51 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:31:51 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:31:51 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk-0R9WPybxA-2xQ3hoXaanrsuqL-NlYYPAsRtZp4ojSxkYCSyUe0SkW8fnNIyKWccv96bO0YiDJorwvxKP2YSg6GYz136ft6JABcGmBv9xE_RBx55kRRzM6RNuW8TsUo3AC8S0ExGv9sboLWoQ1vXhea_ylipe0ao_xWMehiQgFniI Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Project-Id: 4d0a755743544f7c97644faad13bdeb4 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesActionsTest-1914558791 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d0a755743544f7c97644faad13bdeb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d0a755743544f7c97644faad13bdeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d0a755743544f7c97644faad13bdeb4"}]}] Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesActionsTest-1914558791 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Tenant-Id: 4d0a755743544f7c97644faad13bdeb4 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesActionsTest-1914558791 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-User: tempest-VolumesActionsTest-1914558791-project-member Apr 12 06:31:51 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:31:51 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:31:51 user devstack@n-api.service[62042]: X-User-Id: 67fbba4b2bbc4bb3b2255ef1facd7442 Apr 12 06:31:51 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesActionsTest-1914558791-project-member Apr 12 06:31:51 user devstack@n-api.service[62042]: method: > Apr 12 06:31:51 user devstack@n-api.service[62042]: exception: Instance 35495bca-759b-4940-af0e-e6da34c73b34 could not be found. Apr 12 06:31:51 user devstack@n-api.service[62042]: action_args: {'id': '35495bca-759b-4940-af0e-e6da34c73b34'} Apr 12 06:31:51 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35495bca-759b-4940-af0e-e6da34c73b34 could not be found. Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35495bca-759b-4940-af0e-e6da34c73b34 could not be found. Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35495bca-759b-4940-af0e-e6da34c73b34 could not be found. Apr 12 06:31:51 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:31:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Returning 404 to user: Instance 35495bca-759b-4940-af0e-e6da34c73b34 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:31:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c8e30d13-dc8d-4e7d-a66b-41545f253600 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34" status: 404 len: 111 microversion: 2.1 time: 0.034725 Apr 12 06:31:51 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:51 2023] GET /compute/v2.1/servers/35495bca-759b-4940-af0e-e6da34c73b34 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-166257788", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] validate_networks() for [('f297c8e7-b3ac-4aa8-9a82-58dc197846a8', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Getting quotas for project 4d0a755743544f7c97644faad13bdeb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Getting quotas for user 67fbba4b2bbc4bb3b2255ef1facd7442 and project 4d0a755743544f7c97644faad13bdeb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:31:52 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:31:52 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.680502 Apr 12 06:31:52 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 160/478] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:31:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:31:52 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e8b723dc-6014-4582-82cf-5d9f3b354a05 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:31:52 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e8b723dc-6014-4582-82cf-5d9f3b354a05 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:31:52 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-e8b723dc-6014-4582-82cf-5d9f3b354a05 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:31:52 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e8b723dc-6014-4582-82cf-5d9f3b354a05 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25" status: 200 len: 1207 microversion: 2.1 time: 0.062668 Apr 12 06:31:52 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 160/479] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:31:52 2023] GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25 => generated 1207 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:31:55 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487bc635-136c-43b1-8cb2-f233a0beaa25", "tag": "47d2a1d0-2b44-4c97-a535-93b333238ea6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:55 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Creating event network-changed:47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance 487bc635-136c-43b1-8cb2-f233a0beaa25 on user Apr 12 06:31:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095952 Apr 12 06:31:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 160/480] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:57 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487bc635-136c-43b1-8cb2-f233a0beaa25", "name": "network-vif-plugged", "status": "completed", "tag": "47d2a1d0-2b44-4c97-a535-93b333238ea6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Creating event network-vif-plugged:47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance 487bc635-136c-43b1-8cb2-f233a0beaa25 on user Apr 12 06:31:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046068 Apr 12 06:31:57 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 161/481] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:31:59 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487bc635-136c-43b1-8cb2-f233a0beaa25", "name": "network-vif-plugged", "status": "completed", "tag": "47d2a1d0-2b44-4c97-a535-93b333238ea6"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:31:59 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=13 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:31:59 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:31:59 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:31:59 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:31:59 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Creating event network-vif-plugged:47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance 487bc635-136c-43b1-8cb2-f233a0beaa25 on user Apr 12 06:31:59 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038903 Apr 12 06:31:59 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 161/482] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:31:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:02 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-44e7911d-0df1-4ff5-bbee-144b92fceaaa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1756 microversion: 2.87 time: 0.346454 Apr 12 06:32:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 161/483] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:32:02 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1756 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HTTP exception thrown: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Request method failure captured: Apr 12 06:32:05 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 HTTP/1.1 Apr 12 06:32:05 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:32:05 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:32:05 user devstack@n-api.service[62040]: Connection: close Apr 12 06:32:05 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:32:05 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:32:05 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:32:05 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:32:05 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk3wXgl1mVsWDH4mYGGDUFyKM_5wX_gB9XRc5ZeUQwnIcBUCFf9NVE9SOAgdUv-fdPR8CrtE3noGuEl1snoVYf4iTzfPGlZBMWCVYUHFNW3WSgNKlUE2wtE2ZPbUgMu99ATXx_x94ZrsnKEECdV4ko5hjRAu8iTazgRuL2ee8fC4Y9E Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Project-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}] Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Tenant-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:32:05 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:32:05 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:32:05 user devstack@n-api.service[62040]: X-User-Id: d58cc232d0094bebacf147c6b61a0989 Apr 12 06:32:05 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:32:05 user devstack@n-api.service[62040]: method: > Apr 12 06:32:05 user devstack@n-api.service[62040]: exception: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:32:05 user devstack@n-api.service[62040]: action_args: {'id': '7dee97a4-9497-43c2-a688-7bedd1441885'} Apr 12 06:32:05 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:32:05 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Returning 404 to user: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:32:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5388f469-f88a-4b7c-b652-bfc9f4232891 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 404 len: 111 microversion: 2.1 time: 0.034878 Apr 12 06:32:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 162/484] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:05 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:32:05 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3d5436cd-d33a-43ba-854a-6bb4bc9280f6 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '.version_select at 0x7fd24dca0a60>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:05 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3d5436cd-d33a-43ba-854a-6bb4bc9280f6 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673948167" status: 202 len: 0 microversion: 2.1 time: 0.024270 Apr 12 06:32:05 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 162/485] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 06:32:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673948167 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:32:06 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1e10a115-0748-45dd-b73c-9950551795e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: .version_select at 0x7fd24db308b0>, body: {"keypair": {"name": "tempest-keypair-2126669667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpZmXYWicFrSyEtfpqfjfAIQY8glRt1/Lngk2QXW7mMzJ4XKM2JZgEBDcZ7pJJqIQepA9AdE8IqzBjQ9qfKnDJiYCtISr/pNtvWIW/u53rEIRJksUDTXtz1fCyVBDg34A=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:06 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-1e10a115-0748-45dd-b73c-9950551795e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for project 4f124d62c4d345d9af22f1557abca276. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:32:06 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-1e10a115-0748-45dd-b73c-9950551795e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for user d58cc232d0094bebacf147c6b61a0989 and project 4f124d62c4d345d9af22f1557abca276. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:32:06 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1e10a115-0748-45dd-b73c-9950551795e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046468 Apr 12 06:32:06 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 162/486] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:32:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1012542406", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8173354d-cba7-49f6-8229-6c9ee13ddb0f"}], "security_groups": [{"name": "tempest-securitygroup--845941571"}], "key_name": "tempest-keypair-2126669667", "user_data": "}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] validate_networks() for [('8173354d-cba7-49f6-8229-6c9ee13ddb0f', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:08 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-278c7a97-c2ce-4d69-a1a4-ba0d44ca7660 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1503 microversion: 2.1 time: 0.159603 Apr 12 06:32:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 163/487] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:08 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for project 4f124d62c4d345d9af22f1557abca276. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting quotas for user d58cc232d0094bebacf147c6b61a0989 and project 4f124d62c4d345d9af22f1557abca276. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:32:08 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:32:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.528775 Apr 12 06:32:08 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 163/488] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:32:08 2023] POST /compute/v2.1/servers => generated 399 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:32:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-bc59af1e-666a-45ef-b94e-ec4d57cd87e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:08 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-bc59af1e-666a-45ef-b94e-ec4d57cd87e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:08 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-bc59af1e-666a-45ef-b94e-ec4d57cd87e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-bc59af1e-666a-45ef-b94e-ec4d57cd87e2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 200 len: 1232 microversion: 2.1 time: 0.062486 Apr 12 06:32:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 163/489] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:08 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 1232 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:11 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Creating event network-changed:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:32:11 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032058 Apr 12 06:32:11 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 164/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:12 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4e7591e3-b3f1-43bc-a295-a75d50866312 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 200 len: 1545 microversion: 2.1 time: 0.142854 Apr 12 06:32:12 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 164/491] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:12 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 1545 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:13 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "name": "network-vif-plugged", "status": "completed", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:13 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Creating event network-vif-plugged:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:32:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059223 Apr 12 06:32:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 164/492] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "name": "network-vif-plugged", "status": "completed", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Creating event network-vif-plugged:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:32:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038679 Apr 12 06:32:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 165/493] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=14 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:26 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549eaf8464b64c96ab3c6dde394cc31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdd9f4006d413686bba37f22374759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d35ef3af-4582-43f4-a353-52f26efa8888 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2" status: 200 len: 1568 microversion: 2.1 time: 0.172017 Apr 12 06:32:26 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 165/494] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:26 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Creating event network-changed:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:32:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089128 Apr 12 06:32:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 165/495] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9545da1e-1977-434b-9228-c5c2ff1cc9fc"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315121 Apr 12 06:32:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 166/496] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:32:29 2023] POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] HTTP exception thrown: Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 could not be found. Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Request method failure captured: Apr 12 06:32:31 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1 HTTP/1.1 Apr 12 06:32:31 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:32:31 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:32:31 user devstack@n-api.service[62040]: Connection: close Apr 12 06:32:31 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:32:31 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:32:31 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:32:31 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:32:31 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk8kgBUTNcFDXXopl7dEtfauC-siYqk-Z2G-3FoQ2yKts-gHdaG28g7XKrh6Xros-7ZiRRZYD2fNaQBViwIFX7gbyJlQlctJbrRp9D23hdODg8yHe_kcPf_eIS1h46BYo98wpL6MEoKe1MGBC4SDNkDLQ_9EhhSNEz585d57eJ8EOq8 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Project-Id: 0b656fa0bf05484889563c50ccc9a7e9 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesAdminNegativeTest-1313851069 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b656fa0bf05484889563c50ccc9a7e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b656fa0bf05484889563c50ccc9a7e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b656fa0bf05484889563c50ccc9a7e9"}]}] Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesAdminNegativeTest-1313851069 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Tenant-Id: 0b656fa0bf05484889563c50ccc9a7e9 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1313851069 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-User: tempest-VolumesAdminNegativeTest-1313851069-project-member Apr 12 06:32:31 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:32:31 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:32:31 user devstack@n-api.service[62040]: X-User-Id: d682efe6338b4989beb714cce25e8e31 Apr 12 06:32:31 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesAdminNegativeTest-1313851069-project-member Apr 12 06:32:31 user devstack@n-api.service[62040]: method: > Apr 12 06:32:31 user devstack@n-api.service[62040]: exception: Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 could not be found. Apr 12 06:32:31 user devstack@n-api.service[62040]: action_args: {'id': '11dc4450-74e9-48ab-9de3-024baa6af9f1'} Apr 12 06:32:31 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 could not be found. Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 could not be found. Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 could not be found. Apr 12 06:32:31 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:32:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Returning 404 to user: Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:32:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e8339a48-2ee6-43e8-b513-836071d0eb2d tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1" status: 404 len: 111 microversion: 2.1 time: 0.131252 Apr 12 06:32:31 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 166/497] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:31 2023] GET /compute/v2.1/servers/11dc4450-74e9-48ab-9de3-024baa6af9f1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/action" status: 202 len: 0 microversion: 2.1 time: 0.190810 Apr 12 06:32:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 166/498] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:32:31 2023] POST /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:32 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1f37567f-f307-4691-be26-359d4a64077e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1730 microversion: 2.1 time: 0.571069 Apr 12 06:32:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 167/499] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:32 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1730 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-unplugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Creating event network-vif-unplugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:32:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:32:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037521 Apr 12 06:32:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 167/500] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:32:35 user devstack@n-api.service[62042]: DEBUG nova.compute.api [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:32:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056656 Apr 12 06:32:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 167/501] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:32:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094" status: 204 len: 0 microversion: 2.1 time: 0.143366 Apr 12 06:32:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 168/502] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:32:36 2023] DELETE /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:37 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5f813f28-2691-45f6-af66-fa3f425ba1da tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094" status: 200 len: 1668 microversion: 2.1 time: 0.189593 Apr 12 06:32:37 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 168/503] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:36 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094 => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "name": "network-vif-unplugged", "status": "completed", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Creating event network-vif-unplugged:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:32:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087390 Apr 12 06:32:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 168/504] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "name": "network-vif-deleted", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] Creating event network-vif-deleted:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:32:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033834 Apr 12 06:32:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 169/505] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78558e6-437e-44dd-b6b4-123ed3447094", "name": "network-vif-plugged", "status": "completed", "tag": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Creating event network-vif-plugged:b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance d78558e6-437e-44dd-b6b4-123ed3447094 on user Apr 12 06:32:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034211 Apr 12 06:32:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 169/506] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:43 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-28d5cc4e-9f0d-4e1a-8500-a3dca49da2a4 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25" status: 200 len: 1485 microversion: 2.1 time: 0.170072 Apr 12 06:32:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 169/507] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:42 2023] GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25 => generated 1485 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:43 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'services' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:32:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/9545da1e-1977-434b-9228-c5c2ff1cc9fc" status: 202 len: 0 microversion: 2.1 time: 0.200737 Apr 12 06:32:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 170/508] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:32:43 2023] DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/9545da1e-1977-434b-9228-c5c2ff1cc9fc => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2fb2d27a-e910-4c8a-8bad-64410c59720f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052863 Apr 12 06:32:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 170/509] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:32:43 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:32:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:32:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048882 Apr 12 06:32:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 170/510] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:32:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:32:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033181 Apr 12 06:32:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 171/511] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:32:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=26 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:32:58 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:32:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-26d364f4-3adf-4110-85ff-63462be42254 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 200 len: 1538 microversion: 2.1 time: 0.208471 Apr 12 06:32:58 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 171/512] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:32:58 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 1538 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/action" status: 202 len: 0 microversion: 2.87 time: 0.077920 Apr 12 06:33:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 171/513] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:33:02 2023] POST /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:02 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:03 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:03 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:03 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-58f292e0-b23d-4f43-b925-e3a4d3a91a39 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1764 microversion: 2.87 time: 0.237278 Apr 12 06:33:03 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 172/514] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:33:02 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1764 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:33:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-unplugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Creating event network-vif-unplugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:33:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032813 Apr 12 06:33:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 172/515] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:05 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}, {"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:33:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:33:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042715 Apr 12 06:33:05 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 172/516] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:07 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:07 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:33:07 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028413 Apr 12 06:33:07 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 173/517] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:09 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:33:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/action" status: 200 len: 32 microversion: 2.1 time: 0.117115 Apr 12 06:33:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 173/518] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:33:09 2023] POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:10 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4877d932-04c0-4c1f-b916-32b6e6662a1c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1509 microversion: 2.1 time: 0.459361 Apr 12 06:33:10 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 173/519] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:33:09 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:33:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-unplugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Creating event network-vif-unplugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:33:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030660 Apr 12 06:33:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 174/520] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-058f41cc-9882-40a1-b31e-e89b9f1aa171 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.089296 Apr 12 06:33:12 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 174/521] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:33:12 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-interface => generated 282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:33:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031045 Apr 12 06:33:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 174/522] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Creating event network-changed:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:33:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Apr 12 06:33:13 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 175/523] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a8212476-df20-4526-b5de-74477168fd8c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/ips" status: 200 len: 108 microversion: 2.1 time: 0.040104 Apr 12 06:33:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 175/524] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:33:13 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7604ff57-70fb-4c5c-abde-c58dab75bf44"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}, {"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:33:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:33:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029965 Apr 12 06:33:14 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 176/525] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281671 Apr 12 06:33:14 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 175/526] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:33:14 2023] POST /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:22 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2ece05b5-3522-45db-b656-cc732c1c6503 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: .version_select at 0x7fd24dbabeb0>, body: {"keypair": {"name": "tempest-keypair-1092224738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNwlM6zSnkK1jad1V9qKi524+E4rmQa144JesydPzqH82Ovc0LOKIywWpQOwMA7pWSHkpAa5K56dCsv1Gsc/gnYUBqF08xTKKJ5aK4Ulo5NbEwkjx1hIBc1S3H5NYx0MQ=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:22 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-2ece05b5-3522-45db-b656-cc732c1c6503 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:33:22 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-2ece05b5-3522-45db-b656-cc732c1c6503 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:33:22 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2ece05b5-3522-45db-b656-cc732c1c6503 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049913 Apr 12 06:33:22 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 176/527] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:33:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:22 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d2fee73e-670e-4977-b613-19f23459ccea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1723 microversion: 2.1 time: 0.160343 Apr 12 06:33:22 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 177/528] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:33:22 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-945949060", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "50460fb0-3b6e-4da6-890c-1777c1d64acc"}], "security_groups": [{"name": "tempest-securitygroup--1794225577"}], "key_name": "tempest-keypair-1092224738", "user_data": "}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] validate_networks() for [('50460fb0-3b6e-4da6-890c-1777c1d64acc', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:33:24 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:33:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.877391 Apr 12 06:33:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 176/529] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:33:24 2023] POST /compute/v2.1/servers => generated 400 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:33:25 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:25 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d3e2d18c-9a36-4126-9311-eb94f444fd52 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:25 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d3e2d18c-9a36-4126-9311-eb94f444fd52 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:25 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d3e2d18c-9a36-4126-9311-eb94f444fd52 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d3e2d18c-9a36-4126-9311-eb94f444fd52 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 200 len: 1235 microversion: 2.1 time: 0.082459 Apr 12 06:33:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 177/530] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:33:25 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] HTTP exception thrown: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Request method failure captured: Apr 12 06:33:27 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094 HTTP/1.1 Apr 12 06:33:27 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:33:27 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:33:27 user devstack@n-api.service[62041]: Connection: close Apr 12 06:33:27 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:33:27 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:33:27 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:33:27 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:33:27 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk8kgBUTNcFDXXopl7dEtfauC-siYqk-Z2G-3FoQ2yKts-gHdaG28g7XKrh6Xros-7ZiRRZYD2fNaQBViwIFX7gbyJlQlctJbrRp9D23hdODg8yHe_kcPf_eIS1h46BYo98wpL6MEoKe1MGBC4SDNkDLQ_9EhhSNEz585d57eJ8EOq8 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Project-Id: 0b656fa0bf05484889563c50ccc9a7e9 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Project-Name: tempest-VolumesAdminNegativeTest-1313851069 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b656fa0bf05484889563c50ccc9a7e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b656fa0bf05484889563c50ccc9a7e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b656fa0bf05484889563c50ccc9a7e9"}]}] Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Tenant: tempest-VolumesAdminNegativeTest-1313851069 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Tenant-Id: 0b656fa0bf05484889563c50ccc9a7e9 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1313851069 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-User: tempest-VolumesAdminNegativeTest-1313851069-project-member Apr 12 06:33:27 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:33:27 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:33:27 user devstack@n-api.service[62041]: X-User-Id: d682efe6338b4989beb714cce25e8e31 Apr 12 06:33:27 user devstack@n-api.service[62041]: X-User-Name: tempest-VolumesAdminNegativeTest-1313851069-project-member Apr 12 06:33:27 user devstack@n-api.service[62041]: method: > Apr 12 06:33:27 user devstack@n-api.service[62041]: exception: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. Apr 12 06:33:27 user devstack@n-api.service[62041]: action_args: {'id': 'd78558e6-437e-44dd-b6b4-123ed3447094'} Apr 12 06:33:27 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. Apr 12 06:33:27 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:33:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Returning 404 to user: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:33:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fa84495d-9f55-4bf3-b200-db8d79204c92 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094" status: 404 len: 111 microversion: 2.1 time: 0.027654 Apr 12 06:33:27 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 178/531] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:33:27 2023] GET /compute/v2.1/servers/d78558e6-437e-44dd-b6b4-123ed3447094 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:33:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-90b24f41-212b-4b00-9224-565bdb888d0a tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Calling method '.version_select at 0x7fd24db32a70>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-90b24f41-212b-4b00-9224-565bdb888d0a tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771315456" status: 202 len: 0 microversion: 2.1 time: 0.026490 Apr 12 06:33:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:33:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771315456 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:33:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Creating event network-changed:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:33:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034450 Apr 12 06:33:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 178/533] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "name": "network-vif-plugged", "status": "completed", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Creating event network-vif-plugged:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:33:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034227 Apr 12 06:33:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 179/534] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "name": "network-vif-plugged", "status": "completed", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Creating event network-vif-plugged:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:33:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031599 Apr 12 06:33:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 178/535] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e41eb3c4-a2fa-46dd-b13b-9952dd63274f tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056134 Apr 12 06:33:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 179/536] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:33:33 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1352a4c5-edb1-4cf3-8768-5ef649fe2bf8"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=19 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=25 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299703 Apr 12 06:33:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 180/537] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:33:36 2023] POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:33:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25" status: 204 len: 0 microversion: 2.1 time: 0.150092 Apr 12 06:33:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 179/538] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:33:43 2023] DELETE /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=8 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487bc635-136c-43b1-8cb2-f233a0beaa25", "name": "network-vif-unplugged", "status": "completed", "tag": "47d2a1d0-2b44-4c97-a535-93b333238ea6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Creating event network-vif-unplugged:47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance 487bc635-136c-43b1-8cb2-f233a0beaa25 on user Apr 12 06:33:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031537 Apr 12 06:33:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 180/539] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3a1e3597-7e71-4e42-9777-fb8e481a33e9 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25" status: 200 len: 1491 microversion: 2.1 time: 0.263788 Apr 12 06:33:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 180/540] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:33:43 2023] GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25 => generated 1491 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:33:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2b712b59-4823-4d00-a18a-3e0c8788cf9d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Action: 'create', calling method: .version_select at 0x7fd24db7a170>, body: {"keypair": {"name": "tempest-keypair-966536347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeOfWyak7L55BxU3CMZi8GQ9bZKqJlv/bIHJUXC8z3n705CqYiYWSJdMemQWwpBLyJE0B9ZyBbzqhcedALA6IEN7DJXMfRd9zTiTIeQNDyku00pbbHhb7qWZLZaOCMNzA=="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:44 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-2b712b59-4823-4d00-a18a-3e0c8788cf9d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting quotas for project aa21d19689b343dd935505ba458dd6af. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:33:44 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-2b712b59-4823-4d00-a18a-3e0c8788cf9d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting quotas for user 0ed0f651f79846138e3be8f312b3188f and project aa21d19689b343dd935505ba458dd6af. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:33:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2b712b59-4823-4d00-a18a-3e0c8788cf9d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.553579 Apr 12 06:33:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 181/541] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:33:43 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:44 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'services' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:33:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/1352a4c5-edb1-4cf3-8768-5ef649fe2bf8" status: 202 len: 0 microversion: 2.1 time: 0.201580 Apr 12 06:33:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 181/542] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:33:44 2023] DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b4b5aed5-7ca5-4d72-9291-d0072965c55a tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060195 Apr 12 06:33:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 181/543] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:33:44 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:45 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1023741247", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "76d55312-0797-479f-852c-c1b78a76aa90"}], "security_groups": [{"name": "tempest-securitygroup--2025793068"}], "key_name": "tempest-keypair-966536347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:45 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] validate_networks() for [('76d55312-0797-479f-852c-c1b78a76aa90', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:33:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487bc635-136c-43b1-8cb2-f233a0beaa25", "name": "network-vif-plugged", "status": "completed", "tag": "47d2a1d0-2b44-4c97-a535-93b333238ea6"}, {"server_uuid": "487bc635-136c-43b1-8cb2-f233a0beaa25", "name": "network-vif-deleted", "tag": "47d2a1d0-2b44-4c97-a535-93b333238ea6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Creating event network-vif-plugged:47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance 487bc635-136c-43b1-8cb2-f233a0beaa25 on user Apr 12 06:33:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Creating event network-vif-deleted:47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance 487bc635-136c-43b1-8cb2-f233a0beaa25 on user Apr 12 06:33:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030711 Apr 12 06:33:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 182/544] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting quotas for project aa21d19689b343dd935505ba458dd6af. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting quotas for user 0ed0f651f79846138e3be8f312b3188f and project aa21d19689b343dd935505ba458dd6af. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:33:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:33:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.597530 Apr 12 06:33:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 182/545] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:33:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:33:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d138beeb-761d-4ffd-8647-0bab17c7ab6a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:46 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d138beeb-761d-4ffd-8647-0bab17c7ab6a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:46 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d138beeb-761d-4ffd-8647-0bab17c7ab6a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d138beeb-761d-4ffd-8647-0bab17c7ab6a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1239 microversion: 2.1 time: 0.064919 Apr 12 06:33:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 182/546] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:33:46 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:33:48 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:48 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Creating event network-changed:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:33:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Apr 12 06:33:48 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 183/547] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:51 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:33:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043870 Apr 12 06:33:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 183/548] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:53 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:33:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d8e5ee7b-74d0-4e8e-8466-efe18ed37cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1770 microversion: 2.87 time: 0.177510 Apr 12 06:33:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 183/549] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:33:53 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1770 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:33:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:33:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028814 Apr 12 06:33:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 184/550] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:59 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-df4b77e4-8b21-4f34-83c6-89d2dcc0149a tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.093399 Apr 12 06:33:59 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 184/551] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:33:58 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-interface => generated 283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:33:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:33:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Creating event network-changed:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:33:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036877 Apr 12 06:33:59 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 184/552] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:33:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:33:59 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-7c9fb25b-b7e3-4315-bf9f-4e5d6bd36dae tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/ips" status: 200 len: 105 microversion: 2.1 time: 0.042381 Apr 12 06:33:59 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 185/553] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:33:59 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/ips => generated 105 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:00 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fda79b41-ef0b-4443-ada2-44be0129427b tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1489 microversion: 2.1 time: 0.249533 Apr 12 06:34:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 185/554] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:00 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1489 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1079c4b6-625d-4d6c-9710-702e5aa785ec"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:01 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269902 Apr 12 06:34:01 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 185/555] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:34:01 2023] POST /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4b0ef8fc-169c-4bd0-a74b-22207b35e6bc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047807 Apr 12 06:34:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 186/556] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:34:09 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:09 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-29498b61-4ed3-4029-a5fa-1550b60f8091 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/1079c4b6-625d-4d6c-9710-702e5aa785ec" status: 200 len: 194 microversion: 2.1 time: 0.050841 Apr 12 06:34:09 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 186/557] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 06:34:09 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/1079c4b6-625d-4d6c-9710-702e5aa785ec => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4c733b5-a4df-4f96-8d98-ecf3eef24f50"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286565 Apr 12 06:34:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 186/558] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:34:10 2023] POST /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:15 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-b1e35c5e-8746-432e-8e06-97c4851d486c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 200 len: 1546 microversion: 2.1 time: 0.159378 Apr 12 06:34:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 187/559] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:15 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-79a136e3-3872-4827-a8e6-f0d0d21e4ce7 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051136 Apr 12 06:34:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 187/560] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:34:18 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=19 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:18 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4f8080b7-a70c-4765-b118-436dc922bade tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/1079c4b6-625d-4d6c-9710-702e5aa785ec" status: 200 len: 194 microversion: 2.1 time: 0.047926 Apr 12 06:34:18 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 187/561] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 06:34:18 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/1079c4b6-625d-4d6c-9710-702e5aa785ec => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:18 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'services' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:34:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/1079c4b6-625d-4d6c-9710-702e5aa785ec" status: 202 len: 0 microversion: 2.1 time: 0.158695 Apr 12 06:34:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 188/562] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:34:18 2023] DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/1079c4b6-625d-4d6c-9710-702e5aa785ec => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:20 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:20 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a0a5428c-8dcd-48ec-aa51-54cdec10feca tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/d4c733b5-a4df-4f96-8d98-ecf3eef24f50" status: 200 len: 194 microversion: 2.1 time: 0.046900 Apr 12 06:34:20 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 188/563] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 06:34:20 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/d4c733b5-a4df-4f96-8d98-ecf3eef24f50 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:20 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'services' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:34:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/d4c733b5-a4df-4f96-8d98-ecf3eef24f50" status: 202 len: 0 microversion: 2.1 time: 0.166003 Apr 12 06:34:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 188/564] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:34:20 2023] DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments/d4c733b5-a4df-4f96-8d98-ecf3eef24f50 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4e61d559-5e22-45c4-b8c4-a4c2ccf30ae0 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1723 microversion: 2.1 time: 0.147237 Apr 12 06:34:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 189/565] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:23 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d041cc88-a9f5-4c2b-8a06-c6d289dcec02 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1723 microversion: 2.1 time: 0.179074 Apr 12 06:34:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 189/566] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:23 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:34:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6155c1cd-a21e-4092-82db-665321c0134b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046566 Apr 12 06:34:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 189/567] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:34:23 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-fbd1334b-4db9-48c9-9fa2-7216bf620092 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041678 Apr 12 06:34:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 190/568] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:34:23 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:34:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 204 len: 0 microversion: 2.1 time: 0.105068 Apr 12 06:34:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 190/569] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:34:23 2023] DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:23 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-8918bc9d-478b-49e0-89ac-f5ca7f9b0b4e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 200 len: 1663 microversion: 2.1 time: 0.244661 Apr 12 06:34:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 190/570] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:23 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 1663 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:34:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "name": "network-vif-unplugged", "status": "completed", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Creating event network-vif-unplugged:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:34:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058875 Apr 12 06:34:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 191/571] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:34:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "name": "network-vif-plugged", "status": "completed", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}, {"server_uuid": "7af3e780-e4f5-4ff6-a086-c77485d7ec67", "name": "network-vif-deleted", "tag": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Creating event network-vif-plugged:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:34:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Creating event network-vif-deleted:0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 on user Apr 12 06:34:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031383 Apr 12 06:34:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 191/572] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:34:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=7 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] HTTP exception thrown: Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 could not be found. Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Request method failure captured: Apr 12 06:34:34 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25 HTTP/1.1 Apr 12 06:34:34 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:34:34 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:34:34 user devstack@n-api.service[62040]: Connection: close Apr 12 06:34:34 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:34:34 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:34:34 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:34:34 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:34:34 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk-0R9WPybxA-2xQ3hoXaanrsuqL-NlYYPAsRtZp4ojSxkYCSyUe0SkW8fnNIyKWccv96bO0YiDJorwvxKP2YSg6GYz136ft6JABcGmBv9xE_RBx55kRRzM6RNuW8TsUo3AC8S0ExGv9sboLWoQ1vXhea_ylipe0ao_xWMehiQgFniI Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Project-Id: 4d0a755743544f7c97644faad13bdeb4 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesActionsTest-1914558791 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d0a755743544f7c97644faad13bdeb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d0a755743544f7c97644faad13bdeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d0a755743544f7c97644faad13bdeb4"}]}] Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesActionsTest-1914558791 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Tenant-Id: 4d0a755743544f7c97644faad13bdeb4 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesActionsTest-1914558791 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-User: tempest-VolumesActionsTest-1914558791-project-member Apr 12 06:34:34 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:34:34 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:34:34 user devstack@n-api.service[62040]: X-User-Id: 67fbba4b2bbc4bb3b2255ef1facd7442 Apr 12 06:34:34 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesActionsTest-1914558791-project-member Apr 12 06:34:34 user devstack@n-api.service[62040]: method: > Apr 12 06:34:34 user devstack@n-api.service[62040]: exception: Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 could not be found. Apr 12 06:34:34 user devstack@n-api.service[62040]: action_args: {'id': '487bc635-136c-43b1-8cb2-f233a0beaa25'} Apr 12 06:34:34 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 could not be found. Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 could not be found. Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 could not be found. Apr 12 06:34:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:34:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Returning 404 to user: Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:34:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-67c90861-80ba-4b21-988b-2678488392a0 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25" status: 404 len: 111 microversion: 2.1 time: 0.133565 Apr 12 06:34:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 191/573] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:34 2023] GET /compute/v2.1/servers/487bc635-136c-43b1-8cb2-f233a0beaa25 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=9 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-305d6e98-24fa-42f0-8aca-805895af1aa8 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049830 Apr 12 06:34:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 192/574] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:34:34 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:36 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-142e0ea7-db7a-42ff-bf26-87665dcf4fa6 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1553 microversion: 2.1 time: 0.169706 Apr 12 06:34:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 192/575] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:34:36 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06ddc1aa-31ff-4da3-b156-9b5e7f11274b"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274292 Apr 12 06:34:37 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 192/576] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:34:37 2023] POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:44 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'services' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:34:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/06ddc1aa-31ff-4da3-b156-9b5e7f11274b" status: 202 len: 0 microversion: 2.1 time: 0.166537 Apr 12 06:34:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 193/577] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:34:44 2023] DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/06ddc1aa-31ff-4da3-b156-9b5e7f11274b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d9c20287-d638-4a10-b826-b5b38494e2d9 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049339 Apr 12 06:34:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 193/578] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:34:44 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:53 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:53 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1846086682", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "c152f4eb-1dbe-4252-b242-3f911e389655"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:53 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] validate_networks() for [('c152f4eb-1dbe-4252-b242-3f911e389655', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for user 2e5e4455358643b8830ce8c96aad5aad and project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:34:54 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:34:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.640715 Apr 12 06:34:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 193/579] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:34:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:34:54 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-413fae39-8aa4-4a38-9e22-989526e15c6e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:34:54 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-413fae39-8aa4-4a38-9e22-989526e15c6e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:34:54 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-413fae39-8aa4-4a38-9e22-989526e15c6e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:54 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-413fae39-8aa4-4a38-9e22-989526e15c6e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:54 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-413fae39-8aa4-4a38-9e22-989526e15c6e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:34:54 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-413fae39-8aa4-4a38-9e22-989526e15c6e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14" status: 200 len: 1395 microversion: 2.87 time: 0.078316 Apr 12 06:34:54 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 194/580] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:34:54 2023] GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 => generated 1395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:34:57 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:57 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:57 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:34:57 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:57 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:57 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:57 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Creating event network-changed:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:34:57 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034197 Apr 12 06:34:57 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 194/581] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:34:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-plugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:34:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:34:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:34:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:34:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Creating event network-vif-plugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:34:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 Apr 12 06:34:59 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 194/582] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ce85a4c-100f-44cd-b4a4-a32bac7351a8"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 5364688b-cc08-4407-94f5-974846ae7bb8 while it is in vm_state rescued Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Request method failure captured: Apr 12 06:35:00 user devstack@n-api.service[62042]: request: POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/os-volume_attachments HTTP/1.1 Apr 12 06:35:00 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:35:00 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:35:00 user devstack@n-api.service[62042]: Connection: close Apr 12 06:35:00 user devstack@n-api.service[62042]: Content-Length: 74 Apr 12 06:35:00 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:35:00 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:35:00 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:35:00 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk-JeNy21s7Rknzj_nYv8cM8VvntK8qM6XljS0AYLMp6b6peVEx3_8-7Fdr60hQbsU-v6H8YO8JJkx117AZ6zzEi9eNJl_J-BtRjuUxbU3T67SujETdbUCYBSn16znapXlFxKFgQZopvXzgp3fxTKXFhZD7CaHJqa3SLnDmhazrsekM Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Project-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}] Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Tenant-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:35:00 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:35:00 user devstack@n-api.service[62042]: X-User: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:35:00 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:35:00 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:35:00 user devstack@n-api.service[62042]: X-User-Id: dc8e6af1db834409a4880040a5ef6a5a Apr 12 06:35:00 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:35:00 user devstack@n-api.service[62042]: Apr 12 06:35:00 user devstack@n-api.service[62042]: {"volumeAttachment": {"volumeId": "8ce85a4c-100f-44cd-b4a4-a32bac7351a8"}} Apr 12 06:35:00 user devstack@n-api.service[62042]: method: > Apr 12 06:35:00 user devstack@n-api.service[62042]: exception: Cannot 'attach_volume' instance 5364688b-cc08-4407-94f5-974846ae7bb8 while it is in vm_state rescued Apr 12 06:35:00 user devstack@n-api.service[62042]: action_args: {'server_id': '5364688b-cc08-4407-94f5-974846ae7bb8', 'body': {'volumeAttachment': {'volumeId': '8ce85a4c-100f-44cd-b4a4-a32bac7351a8'}}} Apr 12 06:35:00 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5364688b-cc08-4407-94f5-974846ae7bb8 while it is in vm_state rescued Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5364688b-cc08-4407-94f5-974846ae7bb8 while it is in vm_state rescued Apr 12 06:35:00 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Returning 409 to user: Cannot 'attach_volume' instance 5364688b-cc08-4407-94f5-974846ae7bb8 while it is in vm_state rescued {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c79c41a1-9aef-40bf-ab63-d08c32487acd tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040969 Apr 12 06:35:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 195/583] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:35:00 2023] POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/action" status: 202 len: 0 microversion: 2.1 time: 0.075619 Apr 12 06:35:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 195/584] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:35:00 2023] POST /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:01 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:01 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-cc13f6fb-298e-457d-8b58-ef0d22da0a68 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1497 microversion: 2.1 time: 0.163618 Apr 12 06:35:01 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 195/585] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:00 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:35:01 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-unplugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:01 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Creating event network-vif-unplugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:35:01 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043446 Apr 12 06:35:01 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 196/586] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-plugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Creating event network-vif-plugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:35:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047902 Apr 12 06:35:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 196/587] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:35:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035606 Apr 12 06:35:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 196/588] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:05 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:05 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}, {"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:05 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=15 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:05 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:35:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:35:05 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047162 Apr 12 06:35:05 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 197/589] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:13 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HTTP exception thrown: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Request method failure captured: Apr 12 06:35:14 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 HTTP/1.1 Apr 12 06:35:14 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:35:14 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:35:14 user devstack@n-api.service[62041]: Connection: close Apr 12 06:35:14 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:35:14 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:35:14 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:35:14 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:35:14 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3wXgl1mVsWDH4mYGGDUFyKM_5wX_gB9XRc5ZeUQwnIcBUCFf9NVE9SOAgdUv-fdPR8CrtE3noGuEl1snoVYf4iTzfPGlZBMWCVYUHFNW3WSgNKlUE2wtE2ZPbUgMu99ATXx_x94ZrsnKEECdV4ko5hjRAu8iTazgRuL2ee8fC4Y9E Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Project-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}] Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Tenant-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:14 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:35:14 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:35:14 user devstack@n-api.service[62041]: X-User-Id: d58cc232d0094bebacf147c6b61a0989 Apr 12 06:35:14 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:14 user devstack@n-api.service[62041]: method: > Apr 12 06:35:14 user devstack@n-api.service[62041]: exception: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:14 user devstack@n-api.service[62041]: action_args: {'id': '7af3e780-e4f5-4ff6-a086-c77485d7ec67'} Apr 12 06:35:14 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Returning 404 to user: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f57e891d-01df-47cc-b012-6dcb3cc375bd tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 404 len: 111 microversion: 2.1 time: 0.038537 Apr 12 06:35:14 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 197/590] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:13 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:35:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:14 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:14 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e3625765-a1ad-4973-860f-32c9eeae7e41 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '.version_select at 0x7fd24dba8040>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:14 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e3625765-a1ad-4973-860f-32c9eeae7e41 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126669667" status: 202 len: 0 microversion: 2.1 time: 0.035994 Apr 12 06:35:14 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 197/591] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:35:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126669667 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9134da9e-34a9-4ce4-a3f7-91feb1fb8364 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.110323 Apr 12 06:35:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 198/592] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:35:15 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/os-interface => generated 283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Creating event network-changed:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:35:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029577 Apr 12 06:35:16 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 198/593] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-dd7f8dbb-c14f-407f-9218-9101c99e5981 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/ips" status: 200 len: 109 microversion: 2.1 time: 0.034540 Apr 12 06:35:16 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 198/594] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:35:16 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/ips => generated 109 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7604ff57-70fb-4c5c-abde-c58dab75bf44"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Invalid volume: volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 is already attached to instances: cb572c1a-2901-4b09-920d-e3e0da7765b2 Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:35:16 user devstack@n-api.service[62042]: request: POST /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/os-volume_attachments HTTP/1.1 Apr 12 06:35:16 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:35:16 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:35:16 user devstack@n-api.service[62042]: Connection: close Apr 12 06:35:16 user devstack@n-api.service[62042]: Content-Length: 74 Apr 12 06:35:16 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:35:16 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:35:16 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:35:16 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:35:16 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:35:16 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:35:16 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:35:16 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:35:16 user devstack@n-api.service[62042]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:35:16 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:35:16 user devstack@n-api.service[62042]: Apr 12 06:35:16 user devstack@n-api.service[62042]: {"volumeAttachment": {"volumeId": "7604ff57-70fb-4c5c-abde-c58dab75bf44"}} Apr 12 06:35:16 user devstack@n-api.service[62042]: method: > Apr 12 06:35:16 user devstack@n-api.service[62042]: exception: Invalid volume: volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 is already attached to instances: cb572c1a-2901-4b09-920d-e3e0da7765b2 Apr 12 06:35:16 user devstack@n-api.service[62042]: action_args: {'server_id': '143e1e28-20bd-4cdc-b9e4-c199a3d42e3c', 'body': {'volumeAttachment': {'volumeId': '7604ff57-70fb-4c5c-abde-c58dab75bf44'}}} Apr 12 06:35:16 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 is already attached to instances: cb572c1a-2901-4b09-920d-e3e0da7765b2 Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 is already attached to instances: cb572c1a-2901-4b09-920d-e3e0da7765b2 Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 is already attached to instances: cb572c1a-2901-4b09-920d-e3e0da7765b2 Apr 12 06:35:16 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:16 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 400 to user: Invalid volume: volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 is already attached to instances: cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:16 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-231533b6-fbc3-4bf7-8d17-b6b9eb8af162 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124358 Apr 12 06:35:16 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 199/595] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:35:16 2023] POST /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:35:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 204 len: 0 microversion: 2.1 time: 0.114575 Apr 12 06:35:16 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 199/596] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:35:16 2023] DELETE /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:16 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:16 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ee737d05-8311-40e5-bddb-64b7562522cb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 200 len: 1552 microversion: 2.1 time: 0.228543 Apr 12 06:35:16 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 199/597] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:16 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:35:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "name": "network-vif-unplugged", "status": "completed", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Creating event network-vif-unplugged:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:35:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042917 Apr 12 06:35:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 200/598] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "name": "network-vif-deleted", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] Creating event network-vif-deleted:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:35:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038832 Apr 12 06:35:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 200/599] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c", "name": "network-vif-plugged", "status": "completed", "tag": "e46a4182-23c8-4fd1-9440-cdac8b154ac3"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Creating event network-vif-plugged:e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c on user Apr 12 06:35:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039533 Apr 12 06:35:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 200/600] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HTTP exception thrown: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Request method failure captured: Apr 12 06:35:19 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 HTTP/1.1 Apr 12 06:35:19 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:35:19 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:35:19 user devstack@n-api.service[62042]: Connection: close Apr 12 06:35:19 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:35:19 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:35:19 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:35:19 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:35:19 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk3wXgl1mVsWDH4mYGGDUFyKM_5wX_gB9XRc5ZeUQwnIcBUCFf9NVE9SOAgdUv-fdPR8CrtE3noGuEl1snoVYf4iTzfPGlZBMWCVYUHFNW3WSgNKlUE2wtE2ZPbUgMu99ATXx_x94ZrsnKEECdV4ko5hjRAu8iTazgRuL2ee8fC4Y9E Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Project-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}] Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Tenant-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:19 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:35:19 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:35:19 user devstack@n-api.service[62042]: X-User-Id: d58cc232d0094bebacf147c6b61a0989 Apr 12 06:35:19 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:19 user devstack@n-api.service[62042]: method: > Apr 12 06:35:19 user devstack@n-api.service[62042]: exception: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62042]: action_args: {'id': '7af3e780-e4f5-4ff6-a086-c77485d7ec67'} Apr 12 06:35:19 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Returning 404 to user: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0a0520b5-c4d2-42c9-a565-d891bf54d3f2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 404 len: 111 microversion: 2.1 time: 0.032694 Apr 12 06:35:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 201/601] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:35:19 2023] DELETE /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HTTP exception thrown: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Request method failure captured: Apr 12 06:35:19 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 HTTP/1.1 Apr 12 06:35:19 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:35:19 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:35:19 user devstack@n-api.service[62041]: Connection: close Apr 12 06:35:19 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:35:19 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:35:19 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:35:19 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:35:19 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk3wXgl1mVsWDH4mYGGDUFyKM_5wX_gB9XRc5ZeUQwnIcBUCFf9NVE9SOAgdUv-fdPR8CrtE3noGuEl1snoVYf4iTzfPGlZBMWCVYUHFNW3WSgNKlUE2wtE2ZPbUgMu99ATXx_x94ZrsnKEECdV4ko5hjRAu8iTazgRuL2ee8fC4Y9E Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Project-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}] Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Tenant-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:19 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:35:19 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:35:19 user devstack@n-api.service[62041]: X-User-Id: d58cc232d0094bebacf147c6b61a0989 Apr 12 06:35:19 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:19 user devstack@n-api.service[62041]: method: > Apr 12 06:35:19 user devstack@n-api.service[62041]: exception: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62041]: action_args: {'id': '7af3e780-e4f5-4ff6-a086-c77485d7ec67'} Apr 12 06:35:19 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. Apr 12 06:35:19 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:35:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Returning 404 to user: Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ac793a18-0db3-43cc-990d-8524d8aced96 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67" status: 404 len: 111 microversion: 2.1 time: 0.026730 Apr 12 06:35:19 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 201/602] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:19 2023] GET /compute/v2.1/servers/7af3e780-e4f5-4ff6-a086-c77485d7ec67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HTTP exception thrown: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Request method failure captured: Apr 12 06:35:21 user devstack@n-api.service[62040]: request: DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 HTTP/1.1 Apr 12 06:35:21 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:35:21 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:35:21 user devstack@n-api.service[62040]: Connection: close Apr 12 06:35:21 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:35:21 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:35:21 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:35:21 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:35:21 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk3wXgl1mVsWDH4mYGGDUFyKM_5wX_gB9XRc5ZeUQwnIcBUCFf9NVE9SOAgdUv-fdPR8CrtE3noGuEl1snoVYf4iTzfPGlZBMWCVYUHFNW3WSgNKlUE2wtE2ZPbUgMu99ATXx_x94ZrsnKEECdV4ko5hjRAu8iTazgRuL2ee8fC4Y9E Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Project-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}] Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Tenant-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:21 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:35:21 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:35:21 user devstack@n-api.service[62040]: X-User-Id: d58cc232d0094bebacf147c6b61a0989 Apr 12 06:35:21 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:21 user devstack@n-api.service[62040]: method: > Apr 12 06:35:21 user devstack@n-api.service[62040]: exception: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62040]: action_args: {'id': '7dee97a4-9497-43c2-a688-7bedd1441885'} Apr 12 06:35:21 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Returning 404 to user: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b54f7864-a504-44d6-9eda-0c9f012d650c tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 404 len: 111 microversion: 2.1 time: 0.039127 Apr 12 06:35:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 201/603] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:35:21 2023] DELETE /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HTTP exception thrown: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Request method failure captured: Apr 12 06:35:21 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 HTTP/1.1 Apr 12 06:35:21 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:35:21 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:35:21 user devstack@n-api.service[62042]: Connection: close Apr 12 06:35:21 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:35:21 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:35:21 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:35:21 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:35:21 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk3wXgl1mVsWDH4mYGGDUFyKM_5wX_gB9XRc5ZeUQwnIcBUCFf9NVE9SOAgdUv-fdPR8CrtE3noGuEl1snoVYf4iTzfPGlZBMWCVYUHFNW3WSgNKlUE2wtE2ZPbUgMu99ATXx_x94ZrsnKEECdV4ko5hjRAu8iTazgRuL2ee8fC4Y9E Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Project-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f124d62c4d345d9af22f1557abca276"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f124d62c4d345d9af22f1557abca276"}]}] Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Tenant-Id: 4f124d62c4d345d9af22f1557abca276 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1680327736 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:21 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:35:21 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:35:21 user devstack@n-api.service[62042]: X-User-Id: d58cc232d0094bebacf147c6b61a0989 Apr 12 06:35:21 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeTestJSON-1680327736-project-member Apr 12 06:35:21 user devstack@n-api.service[62042]: method: > Apr 12 06:35:21 user devstack@n-api.service[62042]: exception: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62042]: action_args: {'id': '7dee97a4-9497-43c2-a688-7bedd1441885'} Apr 12 06:35:21 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. Apr 12 06:35:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:35:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Returning 404 to user: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:35:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c212025b-6ed5-46ee-848c-1c244d5de168 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885" status: 404 len: 111 microversion: 2.1 time: 0.033082 Apr 12 06:35:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 202/604] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:21 2023] GET /compute/v2.1/servers/7dee97a4-9497-43c2-a688-7bedd1441885 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:35:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 204 len: 0 microversion: 2.1 time: 0.125567 Apr 12 06:35:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 202/605] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:35:23 2023] DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:23 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-75a8a848-8397-44b1-9c18-b223a0b6bf42 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 200 len: 1729 microversion: 2.1 time: 0.304176 Apr 12 06:35:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 202/606] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:23 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:35:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-unplugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Creating event network-vif-unplugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:35:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035343 Apr 12 06:35:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 203/607] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:25 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-plugged", "status": "completed", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Creating event network-vif-plugged:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:35:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041449 Apr 12 06:35:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 203/608] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5758b9-4f7e-4e85-8181-e3dfdd84e624", "name": "network-vif-deleted", "tag": "8fba3fe8-62b6-46be-a025-3ec5a629ee80"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] Creating event network-vif-deleted:8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 on user Apr 12 06:35:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036982 Apr 12 06:35:26 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 203/609] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:35:34 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=13 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:34 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=26 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-87171c34-d20d-4be5-bd0e-cfc76dbf6ad6 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.269615 Apr 12 06:35:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 204/610] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:35:34 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 25 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ba656963-c156-4587-ae24-f1f9e32e9a3b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.116612 Apr 12 06:35:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 204/611] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:35:36 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-interface => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=22 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8048631f-b3d7-4509-84f6-a042d0643041"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326337 Apr 12 06:35:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 204/612] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:35:37 2023] POST /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Creating event network-changed:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:35:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060420 Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-239131927"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:35:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 205/613] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/action" status: 202 len: 0 microversion: 2.1 time: 0.847230 Apr 12 06:35:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 205/614] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:35:38 2023] POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 06:35:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4aedc248-2226-40b3-83d4-50264600f851 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '.version_select at 0x7fd24dbaaf80>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4aedc248-2226-40b3-83d4-50264600f851 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906" status: 200 len: 1606 microversion: 2.1 time: 0.063109 Apr 12 06:35:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 205/615] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 06:35:39 2023] GET /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906 => generated 1606 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:44 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0857f2f1-3308-45b1-b79f-ea9e794ff58c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14" status: 200 len: 1692 microversion: 2.87 time: 0.174534 Apr 12 06:35:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 206/616] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:35:44 2023] GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:46 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'services' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:35:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/8048631f-b3d7-4509-84f6-a042d0643041" status: 202 len: 0 microversion: 2.1 time: 0.177520 Apr 12 06:35:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 206/617] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:35:46 2023] DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments/8048631f-b3d7-4509-84f6-a042d0643041 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f0e02e73-fe61-483d-8a53-9ac9aed3ce41 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Apr 12 06:35:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 206/618] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:35:46 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:35:51 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:35:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-2def8713-f498-4b3d-9d99-67a05eaed9b0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1503 microversion: 2.1 time: 0.195360 Apr 12 06:35:51 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 207/619] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:35:51 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:07 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:36:07 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c HTTP/1.1 Apr 12 06:36:07 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:36:07 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:36:07 user devstack@n-api.service[62041]: Connection: close Apr 12 06:36:07 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:36:07 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:36:07 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:36:07 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:36:07 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:36:07 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:36:07 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:36:07 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:36:07 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:36:07 user devstack@n-api.service[62041]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:36:07 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:36:07 user devstack@n-api.service[62041]: method: > Apr 12 06:36:07 user devstack@n-api.service[62041]: exception: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:36:07 user devstack@n-api.service[62041]: action_args: {'id': '143e1e28-20bd-4cdc-b9e4-c199a3d42e3c'} Apr 12 06:36:07 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:36:07 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:07 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:36:07 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d3f5faa7-e116-4b8b-a547-823234b41501 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 404 len: 111 microversion: 2.1 time: 0.032643 Apr 12 06:36:07 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 207/620] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:07 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:36:07 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:07 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:07 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6355568e-bf5c-456f-8e90-4d5b3d2cc9d8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '.version_select at 0x7fd24dbabc70>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:07 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6355568e-bf5c-456f-8e90-4d5b3d2cc9d8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092224738" status: 202 len: 0 microversion: 2.1 time: 0.029000 Apr 12 06:36:07 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 207/621] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:36:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1092224738 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=20 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:08 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'services' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:36:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments/7604ff57-70fb-4c5c-abde-c58dab75bf44" status: 202 len: 0 microversion: 2.1 time: 0.181176 Apr 12 06:36:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 208/622] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:36:08 2023] DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments/7604ff57-70fb-4c5c-abde-c58dab75bf44 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2e260475-ffcf-4b4e-a225-d28d89dc85d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053635 Apr 12 06:36:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 208/623] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:36:08 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:36:13 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 HTTP/1.1 Apr 12 06:36:13 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:36:13 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:36:13 user devstack@n-api.service[62040]: Connection: close Apr 12 06:36:13 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:36:13 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:36:13 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:36:13 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:36:13 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:36:13 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:13 user devstack@n-api.service[62040]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:36:13 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:36:13 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:36:13 user devstack@n-api.service[62040]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:36:13 user devstack@n-api.service[62040]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:36:13 user devstack@n-api.service[62040]: method: > Apr 12 06:36:13 user devstack@n-api.service[62040]: exception: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:13 user devstack@n-api.service[62040]: action_args: {'id': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'} Apr 12 06:36:13 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:13 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:36:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:36:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a12b7458-2638-4300-ba91-7ed2f47f67f2 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 404 len: 111 microversion: 2.1 time: 0.044598 Apr 12 06:36:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:13 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:36:14 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments HTTP/1.1 Apr 12 06:36:14 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:36:14 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:36:14 user devstack@n-api.service[62042]: Connection: close Apr 12 06:36:14 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:36:14 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:36:14 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:36:14 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:36:14 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:36:14 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:14 user devstack@n-api.service[62042]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:36:14 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:36:14 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:36:14 user devstack@n-api.service[62042]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:36:14 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:36:14 user devstack@n-api.service[62042]: method: > Apr 12 06:36:14 user devstack@n-api.service[62042]: exception: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62042]: action_args: {'server_id': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'} Apr 12 06:36:14 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:36:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-eae84726-461a-4d2d-b076-50ccda5b7329 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031315 Apr 12 06:36:14 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 209/625] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:36:14 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:36:14 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 HTTP/1.1 Apr 12 06:36:14 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:36:14 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:36:14 user devstack@n-api.service[62041]: Connection: close Apr 12 06:36:14 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:36:14 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:36:14 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:36:14 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:36:14 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:36:14 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:36:14 user devstack@n-api.service[62041]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:36:14 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:36:14 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:36:14 user devstack@n-api.service[62041]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:36:14 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:36:14 user devstack@n-api.service[62041]: method: > Apr 12 06:36:14 user devstack@n-api.service[62041]: exception: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62041]: action_args: {'id': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'} Apr 12 06:36:14 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:36:14 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:36:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:36:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-98b04f59-9b40-401b-b152-bd65b3d33236 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 404 len: 111 microversion: 2.1 time: 0.035504 Apr 12 06:36:14 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 209/626] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:14 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-691857628", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "e7da68c2-65d3-464a-9293-6e43665b2422"}], "security_groups": [{"name": "tempest-securitygroup--1531003226"}], "key_name": "tempest-keypair-1698395184", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] validate_networks() for [('e7da68c2-65d3-464a-9293-6e43665b2422', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:36:14 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:36:14 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.559581 Apr 12 06:36:14 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 209/627] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:36:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4d981034-eb58-4095-9cab-684a4c38013a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4d981034-eb58-4095-9cab-684a4c38013a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:14 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-4d981034-eb58-4095-9cab-684a4c38013a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4d981034-eb58-4095-9cab-684a4c38013a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86" status: 200 len: 1232 microversion: 2.1 time: 0.068205 Apr 12 06:36:14 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 210/628] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:14 2023] GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 => generated 1232 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Creating event network-changed:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:36:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028632 Apr 12 06:36:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 210/629] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "name": "network-vif-plugged", "status": "completed", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Creating event network-vif-plugged:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:36:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Apr 12 06:36:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 210/630] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "name": "network-vif-plugged", "status": "completed", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Creating event network-vif-plugged:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:36:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028957 Apr 12 06:36:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 211/631] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fbceec75-50b2-4d2a-b81e-e9f7c5b8e27a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '.version_select at 0x7fd24dca1990>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fbceec75-50b2-4d2a-b81e-e9f7c5b8e27a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906" status: 200 len: 1720 microversion: 2.1 time: 0.299212 Apr 12 06:36:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 211/632] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 06:36:29 2023] GET /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906 => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7d790b23-097e-4310-bf8d-278797fb14a9 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '.version_select at 0x7fd24dba9c60>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7d790b23-097e-4310-bf8d-278797fb14a9 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906" status: 200 len: 1720 microversion: 2.1 time: 0.086536 Apr 12 06:36:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 211/633] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 06:36:29 2023] GET /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906 => generated 1720 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:29 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-da4d2524-37f8-48f0-b309-e513c784098a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1670 microversion: 2.1 time: 0.166972 Apr 12 06:36:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 212/634] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:29 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3fcbf340-ce91-44b2-852c-0838ba17e5dd tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042221 Apr 12 06:36:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 212/635] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:36:36 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1555209203"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14/action" status: 202 len: 52 microversion: 2.87 time: 0.834617 Apr 12 06:36:45 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 212/636] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:36:44 2023] POST /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14/action => generated 52 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=12 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:50 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:50 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:50 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-64470cc4-146c-4efc-8385-7cda7cc7c40b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14" status: 200 len: 1692 microversion: 2.87 time: 0.206544 Apr 12 06:36:50 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 213/637] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:36:50 2023] GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 => generated 1692 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:36:50 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:50 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:36:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:50 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:50 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Creating event network-changed:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:36:50 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032989 Apr 12 06:36:50 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 213/638] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:52 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ce7565de-9a60-44b4-9e31-93ad97df6bad tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'create', calling method: .version_select at 0x7fd24dbabc70>, body: {"keypair": {"name": "tempest-keypair-4832485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAhwxqVzIlu1Y1+woDzJhr+Sp8DkcWAIkNC1v3bFuM/UHwoGWA8kCbJpxtB+g0Vd0L70GVRFQK6LQHpxQxlm74MgcB1oB68hiKHRg3Ayp2r2eMMg/8ksw6i7RnCnnzag=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:52 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-ce7565de-9a60-44b4-9e31-93ad97df6bad tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:36:52 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-ce7565de-9a60-44b4-9e31-93ad97df6bad tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for user dc8e6af1db834409a4880040a5ef6a5a and project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:36:52 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ce7565de-9a60-44b4-9e31-93ad97df6bad tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.053216 Apr 12 06:36:52 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 213/639] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:36:52 2023] POST /compute/v2.1/os-keypairs => generated 383 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:36:54 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2" status: 204 len: 0 microversion: 2.1 time: 0.148782 Apr 12 06:36:54 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 214/640] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:36:54 2023] DELETE /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:54 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549eaf8464b64c96ab3c6dde394cc31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdd9f4006d413686bba37f22374759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-193075a7-88b8-451b-839a-40d911aa2da1 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2" status: 200 len: 1574 microversion: 2.1 time: 0.162903 Apr 12 06:36:54 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 214/641] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:54 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1904973034", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb"}], "security_groups": [{"name": "tempest-securitygroup--111571325"}], "key_name": "tempest-keypair-4832485", "user_data": "}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:54 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Creating event network-vif-unplugged:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:36:54 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078075 Apr 12 06:36:54 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] validate_networks() for [('98448a26-3482-4eb6-91b1-bf8b0c18a3eb', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:36:54 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 215/642] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting quotas for user dc8e6af1db834409a4880040a5ef6a5a and project 972842dc32ee4687866dfe2fbefe9cb4. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:36:55 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:36:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758841 Apr 12 06:36:55 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 214/643] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:36:54 2023] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:36:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-53525721-0740-4646-b695-8adcbb2d5b67 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:55 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-53525721-0740-4646-b695-8adcbb2d5b67 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:55 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-53525721-0740-4646-b695-8adcbb2d5b67 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-53525721-0740-4646-b695-8adcbb2d5b67 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1237 microversion: 2.1 time: 0.064419 Apr 12 06:36:55 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 215/644] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:55 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:36:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "name": "network-vif-deleted", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] Creating event network-vif-deleted:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:36:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086046 Apr 12 06:36:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 216/645] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3770a397-2124-4648-abad-d3ce6483e3b2", "name": "network-vif-plugged", "status": "completed", "tag": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Creating event network-vif-plugged:8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance 3770a397-2124-4648-abad-d3ce6483e3b2 on user Apr 12 06:36:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031322 Apr 12 06:36:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 215/646] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3a041a41-2314-4305-8289-5ec8a2f1a42b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146952 Apr 12 06:36:58 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 216/647] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:36:58 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Creating event network-changed:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:36:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Apr 12 06:36:58 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 216/648] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 204 len: 0 microversion: 2.1 time: 0.116024 Apr 12 06:36:58 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 217/649] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:36:58 2023] DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "name": "network-vif-unplugged", "status": "completed", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:36:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:36:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Creating event network-vif-unplugged:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:36:58 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:36:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029061 Apr 12 06:36:58 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 217/650] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:36:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:36:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1aeca8cf-866e-48d8-adae-ae2b19c7cea0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 200 len: 1669 microversion: 2.1 time: 0.286969 Apr 12 06:36:58 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 217/651] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:36:58 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:37:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "name": "network-vif-deleted", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] Creating event network-vif-deleted:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:37:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028487 Apr 12 06:37:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 218/652] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:37:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029917 Apr 12 06:37:00 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 218/653] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb572c1a-2901-4b09-920d-e3e0da7765b2", "name": "network-vif-plugged", "status": "completed", "tag": "d754ac1a-af83-49a7-8476-727172ee88b1"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Creating event network-vif-plugged:d754ac1a-af83-49a7-8476-727172ee88b1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 on user Apr 12 06:37:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Apr 12 06:37:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 218/654] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:37:02 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030383 Apr 12 06:37:02 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 219/655] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:04 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:05 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ec5d6b87-423a-43f5-a146-cab09478fb7b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86" status: 200 len: 1539 microversion: 2.1 time: 0.161625 Apr 12 06:37:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 219/656] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:04 2023] GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 => generated 1539 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=14 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=22 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:30 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7e4b52e9-680e-4276-b3f7-7c24a93f4c92 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1670 microversion: 2.1 time: 0.153573 Apr 12 06:37:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 219/657] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:30 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff76495e-eafb-4932-9636-e017f0a60dbf"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452208 Apr 12 06:37:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 220/658] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:37:31 2023] POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "ba4fcaaf-a4e2-4cbc-9b41-9028e7147906"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:38 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'flavor' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:37:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/action" status: 200 len: 29 microversion: 2.1 time: 0.240016 Apr 12 06:37:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 220/659] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:37:38 2023] POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/action => generated 29 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:39 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-98dc64fc-85b1-42c9-94b9-371929c863bd tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1722 microversion: 2.1 time: 0.210127 Apr 12 06:37:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 220/660] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:39 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:37:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-unplugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Creating event network-vif-unplugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:37:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038659 Apr 12 06:37:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 221/661] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:37:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:37:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029341 Apr 12 06:37:42 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 221/662] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:37:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028956 Apr 12 06:37:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 221/663] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] HTTP exception thrown: Instance 3770a397-2124-4648-abad-d3ce6483e3b2 could not be found. Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Request method failure captured: Apr 12 06:37:44 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 HTTP/1.1 Apr 12 06:37:44 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:37:44 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:37:44 user devstack@n-api.service[62042]: Connection: close Apr 12 06:37:44 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:37:44 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:37:44 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:37:44 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:37:44 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlABKZmiifALHaJgshkXz3qLDSu74i8EfER-v4nfXe-JzaC9seIuMpuiw5rsZ4YCKEk07swBh219gN_dpGzGLGNuBPTNPtOwxcieKoNTFZ7TVuU4LtcDrTHW3sZMm7qgVYHEsmUg9LIvNA-1sTlpNUcfQNeNJMyjuhCTS-E1Xm--O5w Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Project-Id: 1ebdd9f4006d413686bba37f22374759 Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Project-Name: tempest-SnapshotDataIntegrityTests-2082659614 Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ebdd9f4006d413686bba37f22374759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ebdd9f4006d413686bba37f22374759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ebdd9f4006d413686bba37f22374759"}]}] Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Tenant: tempest-SnapshotDataIntegrityTests-2082659614 Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Tenant-Id: 1ebdd9f4006d413686bba37f22374759 Apr 12 06:37:44 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-2082659614 Apr 12 06:37:44 user devstack@n-api.service[62042]: X-User: tempest-SnapshotDataIntegrityTests-2082659614-project-member Apr 12 06:37:44 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:37:44 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:37:44 user devstack@n-api.service[62042]: X-User-Id: 549eaf8464b64c96ab3c6dde394cc31e Apr 12 06:37:44 user devstack@n-api.service[62042]: X-User-Name: tempest-SnapshotDataIntegrityTests-2082659614-project-member Apr 12 06:37:44 user devstack@n-api.service[62042]: method: > Apr 12 06:37:44 user devstack@n-api.service[62042]: exception: Instance 3770a397-2124-4648-abad-d3ce6483e3b2 could not be found. Apr 12 06:37:44 user devstack@n-api.service[62042]: action_args: {'id': '3770a397-2124-4648-abad-d3ce6483e3b2'} Apr 12 06:37:44 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3770a397-2124-4648-abad-d3ce6483e3b2 could not be found. Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3770a397-2124-4648-abad-d3ce6483e3b2 could not be found. Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3770a397-2124-4648-abad-d3ce6483e3b2 could not be found. Apr 12 06:37:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:37:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Returning 404 to user: Instance 3770a397-2124-4648-abad-d3ce6483e3b2 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:37:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-633a23c4-0373-4ecb-a78f-5bd9027a6963 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2" status: 404 len: 111 microversion: 2.1 time: 0.027609 Apr 12 06:37:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 222/664] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:44 2023] GET /compute/v2.1/servers/3770a397-2124-4648-abad-d3ce6483e3b2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:37:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5f0331ab-d2f6-45aa-82e0-868eb3235623 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Calling method '.version_select at 0x7fd24dbabc70>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5f0331ab-d2f6-45aa-82e0-868eb3235623 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2112427330" status: 202 len: 0 microversion: 2.1 time: 0.025878 Apr 12 06:37:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 222/665] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 12 06:37:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2112427330 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:45 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:45 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ba923346-518c-4b57-bec6-0f2ef9f91c81 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1550 microversion: 2.1 time: 0.220257 Apr 12 06:37:45 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 222/666] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:45 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1550 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:37:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:37:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Apr 12 06:37:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 223/667] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:49 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:37:49 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:37:49 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 HTTP/1.1 Apr 12 06:37:49 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:37:49 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:37:49 user devstack@n-api.service[62040]: Connection: close Apr 12 06:37:49 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:37:49 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:37:49 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:37:49 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:37:49 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:37:49 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:37:49 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:37:49 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:37:49 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:37:49 user devstack@n-api.service[62040]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:37:49 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:37:49 user devstack@n-api.service[62040]: method: > Apr 12 06:37:49 user devstack@n-api.service[62040]: exception: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:37:49 user devstack@n-api.service[62040]: action_args: {'id': 'cb572c1a-2901-4b09-920d-e3e0da7765b2'} Apr 12 06:37:49 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:37:49 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:37:49 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:37:49 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ae6ee2e6-d817-47c9-9e8e-66e42ff86f3f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 404 len: 111 microversion: 2.1 time: 0.039142 Apr 12 06:37:49 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 223/668] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:48 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:37:49 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-42599d5e-2260-447f-a658-4cbd83703058 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '.version_select at 0x7fd24dca2290>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-42599d5e-2260-447f-a658-4cbd83703058 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104449008" status: 202 len: 0 microversion: 2.1 time: 0.029468 Apr 12 06:37:49 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 223/669] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:37:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104449008 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:37:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1decee35-2883-4d30-b897-820a5b9da4b2 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: .version_select at 0x7fd24eaf1a20>, body: {"keypair": {"name": "tempest-keypair-15797926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEW+augvNasE0Qo/REg3jlWWepgI/HiN9UN+M7OdB1zGToWMOZhc9DuX2ID5abQGOcG4pmVkcHOgGwHKchGMi30PiRS5OZhbYr1bILUuP6EjvFAI3iucPvSzavcZAk3qg=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:49 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-1decee35-2883-4d30-b897-820a5b9da4b2 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:37:49 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-1decee35-2883-4d30-b897-820a5b9da4b2 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:37:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1decee35-2883-4d30-b897-820a5b9da4b2 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049101 Apr 12 06:37:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 224/670] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:37:49 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1451717232", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "4f2549ed-915f-4494-87f3-9269834fa9da", "destination_type": "volume"}], "networks": [{"uuid": "c152f4eb-1dbe-4252-b242-3f911e389655"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-724406694", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "50460fb0-3b6e-4da6-890c-1777c1d64acc"}], "security_groups": [{"name": "tempest-securitygroup--1720934369"}], "key_name": "tempest-keypair-15797926", "user_data": "}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] validate_networks() for [('c152f4eb-1dbe-4252-b242-3f911e389655', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] validate_networks() for [('50460fb0-3b6e-4da6-890c-1777c1d64acc', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting quotas for user 2e5e4455358643b8830ce8c96aad5aad and project 0ecae91e53ee4d70a8dc24c7febc2a0e. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:37:51 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:37:51 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.870278 Apr 12 06:37:51 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 224/671] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:37:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:37:51 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.621160 Apr 12 06:37:51 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 224/672] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:37:51 2023] POST /compute/v2.1/servers => generated 400 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:37:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-bb1bf751-4aa7-4d55-a3e6-9c30ef678c8d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:51 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-bb1bf751-4aa7-4d55-a3e6-9c30ef678c8d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1095ca34-4bc4-4041-b428-36ccb43d55fd tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:37:51 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-1095ca34-4bc4-4041-b428-36ccb43d55fd tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:37:52 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-1095ca34-4bc4-4041-b428-36ccb43d55fd tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:52 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1095ca34-4bc4-4041-b428-36ccb43d55fd tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 200 len: 1233 microversion: 2.1 time: 0.069453 Apr 12 06:37:52 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 225/673] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:37:51 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 1233 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:37:52 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-bb1bf751-4aa7-4d55-a3e6-9c30ef678c8d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:52 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-bb1bf751-4aa7-4d55-a3e6-9c30ef678c8d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:52 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-bb1bf751-4aa7-4d55-a3e6-9c30ef678c8d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:37:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-bb1bf751-4aa7-4d55-a3e6-9c30ef678c8d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1395 microversion: 2.87 time: 0.103370 Apr 12 06:37:52 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 225/674] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:37:51 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1395 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:37:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Creating event network-changed:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:37:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060735 Apr 12 06:37:55 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 225/675] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Creating event network-changed:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:37:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161812 Apr 12 06:37:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 226/676] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:37:58 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:37:58 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "name": "network-vif-plugged", "status": "completed", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:37:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:37:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:37:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:37:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Creating event network-vif-plugged:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:37:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111993 Apr 12 06:37:58 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 226/677] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:37:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "name": "network-vif-plugged", "status": "completed", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:00 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:00 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=25 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Creating event network-vif-plugged:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:38:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039431 Apr 12 06:38:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 226/678] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=8 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-9bd1d08e-fd0a-4d07-95be-fc13acf2e3ab tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.200189 Apr 12 06:38:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 227/679] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:38:05 2023] GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86/os-interface => generated 283 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:06 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:06 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:06 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:06 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Creating event network-changed:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:38:06 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032639 Apr 12 06:38:06 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 227/680] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:06 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:06 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:06 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:06 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:06 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:06 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:06 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:38:06 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064400 Apr 12 06:38:06 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:38:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028302 Apr 12 06:38:08 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 228/682] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2019289684", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "e7da68c2-65d3-464a-9293-6e43665b2422"}], "security_groups": [{"name": "tempest-securitygroup--1531003226"}], "key_name": "tempest-keypair-1698395184", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] validate_networks() for [('e7da68c2-65d3-464a-9293-6e43665b2422', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:38:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7',volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:38:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.792390 Apr 12 06:38:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 228/683] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:38:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:38:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3e5b5b58-ac69-4e09-acac-19bca45fbe78 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:09 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3e5b5b58-ac69-4e09-acac-19bca45fbe78 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:10 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-3e5b5b58-ac69-4e09-acac-19bca45fbe78 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3e5b5b58-ac69-4e09-acac-19bca45fbe78 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1076 microversion: 2.1 time: 0.081155 Apr 12 06:38:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 228/684] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:38:09 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1076 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:38:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:13 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:13 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Creating event network-changed:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:38:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043580 Apr 12 06:38:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 229/685] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-plugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Creating event network-vif-plugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:38:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044590 Apr 12 06:38:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 229/686] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-plugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=7 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Creating event network-vif-plugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:38:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043633 Apr 12 06:38:21 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 229/687] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:29 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-407c8917-c479-40cb-983a-f07f0fdd47f8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1702 microversion: 2.1 time: 0.159704 Apr 12 06:38:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 230/688] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:38:29 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:42 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-134a256d-609b-424a-b4a0-55a618513d08 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 200 len: 1543 microversion: 2.1 time: 0.215937 Apr 12 06:38:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 230/689] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:38:42 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 1543 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:42 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9e1a5119-36b2-4754-a485-cb4423fbb00a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1770 microversion: 2.87 time: 0.216402 Apr 12 06:38:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 230/690] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:38:42 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1770 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-484cdc12-5674-4c46-bb44-da0a8587b2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.095456 Apr 12 06:38:45 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 231/691] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:38:45 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-interface => generated 283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Creating event network-changed:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:38:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031169 Apr 12 06:38:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 231/692] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e3910db-ed08-4a5a-bb85-48c49eccbf9a"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281473 Apr 12 06:38:47 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 231/693] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:38:46 2023] POST /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:53 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:38:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/action" status: 200 len: 32 microversion: 2.1 time: 0.162225 Apr 12 06:38:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 232/694] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:38:53 2023] POST /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:53 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:38:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-22221181-38a3-434a-8217-6a690a3e68d2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1720 microversion: 2.1 time: 0.173271 Apr 12 06:38:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 232/695] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:38:53 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:38:54 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Creating event network-vif-unplugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:38:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036002 Apr 12 06:38:54 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 232/696] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:38:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032633 Apr 12 06:38:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 233/697] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:38:58 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}, {"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:38:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:38:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:38:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:38:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:38:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:38:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036515 Apr 12 06:38:58 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 233/698] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:38:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:00 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:39:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ae05607f-d781-4744-bc80-797b1bb6a598 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1428 microversion: 2.1 time: 0.173542 Apr 12 06:39:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 233/699] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:39:00 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1428 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/action" status: 202 len: 0 microversion: 2.1 time: 0.223617 Apr 12 06:39:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 234/700] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:39:29 2023] POST /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=16 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:30 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8a4e0d9e-ddd6-4d77-926f-3491ebc8d9e4 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.104049 Apr 12 06:39:30 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 234/701] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:39:29 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:31 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:39:31 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:39:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Creating event network-changed:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:39:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043079 Apr 12 06:39:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 234/702] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-unplugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Creating event network-vif-unplugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:39:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029529 Apr 12 06:39:31 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 235/703] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:33 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:33 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Creating event network-changed:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:39:33 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030775 Apr 12 06:39:33 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 235/704] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}, {"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:39:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:39:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033471 Apr 12 06:39:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 235/705] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:35 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:39:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029769 Apr 12 06:39:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 236/706] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-04df4f6e-0dc4-4e75-ac23-94a4d994dc47 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091408 Apr 12 06:39:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 236/707] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:39:42 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "31d56266-ff18-4fd7-b5f7-57502c4c2e1e"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:42 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'flavor' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:39:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112/action" status: 200 len: 29 microversion: 2.87 time: 0.490729 Apr 12 06:39:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 236/708] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:39:42 2023] POST /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112/action => generated 29 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Creating event network-changed:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:39:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028710 Apr 12 06:39:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 237/709] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d5003fdf-1bc5-4eaa-8b35-384b96d862fb tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/ips" status: 200 len: 108 microversion: 2.1 time: 0.038031 Apr 12 06:39:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:39:43 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:39:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:39:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5c9d42a6-d1b4-4ce8-bde9-fea30c911cfd tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1776 microversion: 2.87 time: 0.195997 Apr 12 06:39:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 237/711] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:39:43 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1776 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-unplugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Creating event network-vif-unplugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:39:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029050 Apr 12 06:39:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 238/712] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:44 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:39:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4e1e1bb5-78a4-4e15-aad3-c91109d2cfb2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1700 microversion: 2.1 time: 0.335006 Apr 12 06:39:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 238/713] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:39:44 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1700 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7204ed1-e658-42f0-b1fd-590e8b56f1f5"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.245684 Apr 12 06:39:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 238/714] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:39:44 2023] POST /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments => generated 194 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:39:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054013 Apr 12 06:39:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 239/715] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:48 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:48 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:48 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:39:48 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Apr 12 06:39:48 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 239/716] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:39:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032387 Apr 12 06:39:50 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 239/717] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7204ed1-e658-42f0-b1fd-590e8b56f1f5"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Invalid volume: volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 is already attached to instances: f93121be-8fbc-4b92-856a-64bf9f192532 Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:39:53 user devstack@n-api.service[62042]: request: POST /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments HTTP/1.1 Apr 12 06:39:53 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:39:53 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:39:53 user devstack@n-api.service[62042]: Connection: close Apr 12 06:39:53 user devstack@n-api.service[62042]: Content-Length: 74 Apr 12 06:39:53 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:39:53 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:39:53 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:39:53 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:39:53 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:39:53 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:39:53 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:39:53 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:39:53 user devstack@n-api.service[62042]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:39:53 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:39:53 user devstack@n-api.service[62042]: Apr 12 06:39:53 user devstack@n-api.service[62042]: {"volumeAttachment": {"volumeId": "a7204ed1-e658-42f0-b1fd-590e8b56f1f5"}} Apr 12 06:39:53 user devstack@n-api.service[62042]: method: > Apr 12 06:39:53 user devstack@n-api.service[62042]: exception: Invalid volume: volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 is already attached to instances: f93121be-8fbc-4b92-856a-64bf9f192532 Apr 12 06:39:53 user devstack@n-api.service[62042]: action_args: {'server_id': 'f93121be-8fbc-4b92-856a-64bf9f192532', 'body': {'volumeAttachment': {'volumeId': 'a7204ed1-e658-42f0-b1fd-590e8b56f1f5'}}} Apr 12 06:39:53 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 is already attached to instances: f93121be-8fbc-4b92-856a-64bf9f192532 Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 is already attached to instances: f93121be-8fbc-4b92-856a-64bf9f192532 Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 is already attached to instances: f93121be-8fbc-4b92-856a-64bf9f192532 Apr 12 06:39:53 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:39:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 400 to user: Invalid volume: volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 is already attached to instances: f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:39:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8a35c5f6-1271-44af-98eb-4bf774c49fe0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142385 Apr 12 06:39:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 240/718] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:39:53 2023] POST /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:53 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'services' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:39:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments/a7204ed1-e658-42f0-b1fd-590e8b56f1f5" status: 202 len: 0 microversion: 2.1 time: 0.156958 Apr 12 06:39:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 240/719] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:39:53 2023] DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments/a7204ed1-e658-42f0-b1fd-590e8b56f1f5 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:39:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:39:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ea0b3531-02bb-4a55-bf5b-c7cc11364f60 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046501 Apr 12 06:39:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 240/720] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:39:53 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=15 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:00 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=23 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-7309f75a-8940-4973-852c-724fb83613ec tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.111452 Apr 12 06:40:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 241/721] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:40:00 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/os-interface => generated 282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=15 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Creating event network-changed:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:40:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031754 Apr 12 06:40:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 241/722] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=17 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:01 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:01 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4da7b481-95ee-4dcc-839f-9f9326a20b06 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1428 microversion: 2.1 time: 0.144873 Apr 12 06:40:01 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 241/723] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:01 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Old instance type m1.nano, new instance type m1.micro {{(pid=62042) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting quotas for user ad316acdc89947bbba60c75e9a24d7e9 and project 54fd87c4105246c1ac1bdf424c83b7aa. Resources: {'cores', 'ram'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:40:01 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:40:01 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/action" status: 202 len: 0 microversion: 2.1 time: 0.191340 Apr 12 06:40:01 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 242/724] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:40:01 2023] POST /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:01 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:02 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:02 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1a350c78-abac-4d92-9501-988154e80a2e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1437 microversion: 2.1 time: 0.261320 Apr 12 06:40:02 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 242/725] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:01 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1437 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:02 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'services' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:40:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments/ff76495e-eafb-4932-9636-e017f0a60dbf" status: 202 len: 0 microversion: 2.1 time: 0.237709 Apr 12 06:40:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 242/726] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:40:02 2023] DELETE /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments/ff76495e-eafb-4932-9636-e017f0a60dbf => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:03 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:03 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-eee17346-099f-4fb4-bf59-cc809156cf59 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062014 Apr 12 06:40:03 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 243/727] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:40:03 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:03 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Creating event network-changed:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:40:03 user devstack@n-api.service[62041]: DEBUG nova.compute.api [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:40:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039973 Apr 12 06:40:03 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 243/728] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-unplugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}, {"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-plugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Creating event network-vif-unplugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:40:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Creating event network-vif-plugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:40:05 user devstack@n-api.service[62040]: DEBUG nova.compute.api [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:40:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038846 Apr 12 06:40:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 243/729] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-plugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=17 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Creating event network-vif-plugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:40:13 user devstack@n-api.service[62042]: DEBUG nova.compute.api [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:40:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059120 Apr 12 06:40:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 244/730] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-plugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=5 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=11 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Creating event network-vif-plugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:40:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 06:40:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043638 Apr 12 06:40:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 244/731] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=5 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fde1b7e9-ba27-480a-8887-b2ffc262325e tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1756 microversion: 2.87 time: 0.159494 Apr 12 06:40:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 244/732] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:40:33 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:40:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a21c336f-2028-443e-b7e8-c025a90c37e9 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050826 Apr 12 06:40:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 245/733] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:40:43 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:40:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 204 len: 0 microversion: 2.1 time: 0.125762 Apr 12 06:40:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 245/734] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:40:44 2023] DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-78fc195e-1012-46e3-a06b-557cc3b255e8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 200 len: 1667 microversion: 2.1 time: 0.209342 Apr 12 06:40:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 245/735] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:44 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 1667 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "name": "network-vif-unplugged", "status": "completed", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Creating event network-vif-unplugged:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:40:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036821 Apr 12 06:40:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 246/736] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 while it is in vm_state rescued Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Request method failure captured: Apr 12 06:40:44 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments/4e3910db-ed08-4a5a-bb85-48c49eccbf9a HTTP/1.1 Apr 12 06:40:44 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:40:44 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:40:44 user devstack@n-api.service[62042]: Connection: close Apr 12 06:40:44 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:40:44 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:40:44 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:40:44 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:40:44 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk-JeNy21s7Rknzj_nYv8cM8VvntK8qM6XljS0AYLMp6b6peVEx3_8-7Fdr60hQbsU-v6H8YO8JJkx117AZ6zzEi9eNJl_J-BtRjuUxbU3T67SujETdbUCYBSn16znapXlFxKFgQZopvXzgp3fxTKXFhZD7CaHJqa3SLnDmhazrsekM Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Project-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}] Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Tenant-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:40:44 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:40:44 user devstack@n-api.service[62042]: X-User: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:40:44 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:40:44 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:40:44 user devstack@n-api.service[62042]: X-User-Id: dc8e6af1db834409a4880040a5ef6a5a Apr 12 06:40:44 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:40:44 user devstack@n-api.service[62042]: method: > Apr 12 06:40:44 user devstack@n-api.service[62042]: exception: Cannot 'detach_volume' instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 while it is in vm_state rescued Apr 12 06:40:44 user devstack@n-api.service[62042]: action_args: {'server_id': '8bd6a08b-ef82-4019-b5d3-7e84cb241eb9', 'id': '4e3910db-ed08-4a5a-bb85-48c49eccbf9a'} Apr 12 06:40:44 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 while it is in vm_state rescued Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 while it is in vm_state rescued Apr 12 06:40:44 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:40:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Returning 409 to user: Cannot 'detach_volume' instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 while it is in vm_state rescued {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:40:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4bb99644-9c9d-4dcd-9f77-861103d777bb tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments/4e3910db-ed08-4a5a-bb85-48c49eccbf9a" status: 409 len: 152 microversion: 2.1 time: 0.114211 Apr 12 06:40:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 246/737] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:40:44 2023] DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments/4e3910db-ed08-4a5a-bb85-48c49eccbf9a => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.088945 Apr 12 06:40:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 246/738] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:40:44 2023] POST /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:44 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c6344d3f-28ca-4f49-9276-b6f6fb675935 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1708 microversion: 2.1 time: 0.238587 Apr 12 06:40:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 247/739] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:44 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1708 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:40:45 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Creating event network-vif-unplugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:40:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030834 Apr 12 06:40:45 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 247/740] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:46 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "name": "network-vif-plugged", "status": "completed", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:46 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Creating event network-vif-plugged:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:40:46 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027968 Apr 12 06:40:46 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 247/741] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:47 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}, {"server_uuid": "f93121be-8fbc-4b92-856a-64bf9f192532", "name": "network-vif-deleted", "tag": "48268378-1f2b-42d7-b20a-631f3de87f6b"}, {"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:40:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Creating event network-vif-deleted:48268378-1f2b-42d7-b20a-631f3de87f6b for instance f93121be-8fbc-4b92-856a-64bf9f192532 on user Apr 12 06:40:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:40:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034796 Apr 12 06:40:47 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 248/742] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:47 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:40:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Apr 12 06:40:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 248/743] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:52 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:52 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-9b238540-217e-4c0a-9ab9-c8696d737001 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1554 microversion: 2.1 time: 0.168063 Apr 12 06:40:52 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 248/744] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:52 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:53 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-14b5f851-a6d1-41c8-9ca3-0c74e9ff7a4a tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049008 Apr 12 06:40:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 249/745] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:40:53 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:40:55 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-56d9f624-1ad6-4348-8ae2-3aac7ce7183f tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '.version_select at 0x7fd24dde9750>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-56d9f624-1ad6-4348-8ae2-3aac7ce7183f tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906" status: 204 len: 0 microversion: 2.1 time: 0.226223 Apr 12 06:40:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 249/746] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:55 2023] DELETE /compute/v2.1/images/ba4fcaaf-a4e2-4cbc-9b41-9028e7147906 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:55 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:40:55 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 204 len: 0 microversion: 2.1 time: 0.125320 Apr 12 06:40:55 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 249/747] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:40:55 2023] DELETE /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:56 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:40:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6db9beda-5db6-41aa-a885-e8dfbcb75c18 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 200 len: 1676 microversion: 2.1 time: 0.188761 Apr 12 06:40:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 250/748] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:40:55 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:40:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-unplugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Creating event network-vif-unplugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:40:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033072 Apr 12 06:40:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 250/749] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:57 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-deleted", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] Creating event network-vif-deleted:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:40:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080518 Apr 12 06:40:57 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 250/750] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:40:58 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bef2d11-2dfe-47cb-a1ed-3331038ecd99", "name": "network-vif-plugged", "status": "completed", "tag": "f90233ae-9ecb-48be-baf0-7e517849679d"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:40:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:40:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:40:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:40:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Creating event network-vif-plugged:f90233ae-9ecb-48be-baf0-7e517849679d for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 on user Apr 12 06:40:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Apr 12 06:40:58 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 251/751] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=18 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:33 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:33 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "POST /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112/action" status: 202 len: 0 microversion: 2.87 time: 0.087224 Apr 12 06:41:33 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 251/752] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:41:33 2023] POST /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:41:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:41:34 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:41:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-8e7ad244-73d8-4d04-a050-ab70007f63aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1764 microversion: 2.87 time: 0.273509 Apr 12 06:41:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 251/753] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:41:33 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1764 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:41:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-unplugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:34 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:34 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Creating event network-vif-unplugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:41:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039687 Apr 12 06:41:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 252/754] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:41:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:41:34 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 HTTP/1.1 Apr 12 06:41:34 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:41:34 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:41:34 user devstack@n-api.service[62042]: Connection: close Apr 12 06:41:34 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:41:34 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:41:34 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:41:34 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:41:34 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:41:34 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:41:34 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:41:34 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:41:34 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:41:34 user devstack@n-api.service[62042]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:41:34 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:41:34 user devstack@n-api.service[62042]: method: > Apr 12 06:41:34 user devstack@n-api.service[62042]: exception: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:41:34 user devstack@n-api.service[62042]: action_args: {'id': 'f93121be-8fbc-4b92-856a-64bf9f192532'} Apr 12 06:41:34 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:41:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:41:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:41:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-cb4a6afe-a772-4c63-bdef-1d5c8fefa996 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 404 len: 111 microversion: 2.1 time: 0.031897 Apr 12 06:41:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 252/755] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:41:34 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:41:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e517140d-338d-40f6-820f-5a4702aed44d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '.version_select at 0x7fd24dbaac20>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e517140d-338d-40f6-820f-5a4702aed44d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15797926" status: 202 len: 0 microversion: 2.1 time: 0.030026 Apr 12 06:41:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 252/756] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 06:41:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15797926 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:35 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:41:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-dc6a1ef6-5509-470f-bfe3-ede5205c1677 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1714 microversion: 2.1 time: 0.237702 Apr 12 06:41:35 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 253/757] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:41:35 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1714 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:41:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a87fc10c-1261-477b-a1a7-30fa6842a4b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: .version_select at 0x7fd24e041630>, body: {"keypair": {"name": "tempest-keypair-1165194356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJovVVq9DlDt8OQJmv/ymM2orTxdeZEzo0KqhHfwyEqKcuzEEqG1eSncSTiiH+GPjR0VagPk4aBi/3x6BLntkCMzQHvNNCjXhV3C26xfCb1BqKX/0T8BZsCsPN0Rhy0ew=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:35 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-a87fc10c-1261-477b-a1a7-30fa6842a4b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:41:35 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-a87fc10c-1261-477b-a1a7-30fa6842a4b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:41:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a87fc10c-1261-477b-a1a7-30fa6842a4b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059536 Apr 12 06:41:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 253/758] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:41:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}, {"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:41:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:41:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035583 Apr 12 06:41:36 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 253/759] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:41:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-575862616", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "50460fb0-3b6e-4da6-890c-1777c1d64acc"}], "security_groups": [{"name": "tempest-securitygroup--1038079097"}], "key_name": "tempest-keypair-1165194356", "user_data": "}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] validate_networks() for [('50460fb0-3b6e-4da6-890c-1777c1d64acc', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting quotas for user d6cd1f8b3c0d42298f6f4a303f1251ec and project b267dce1303d451ca307eeaa38baf685. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:41:37 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:41:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.949686 Apr 12 06:41:37 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 254/760] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:41:36 2023] POST /compute/v2.1/servers => generated 400 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:41:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dad0a6c1-bf07-421a-ba76-8c146a0080f7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:37 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-dad0a6c1-bf07-421a-ba76-8c146a0080f7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:37 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-dad0a6c1-bf07-421a-ba76-8c146a0080f7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:41:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-dad0a6c1-bf07-421a-ba76-8c146a0080f7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 200 len: 1235 microversion: 2.1 time: 0.070528 Apr 12 06:41:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 254/761] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:41:37 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:41:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:41:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037956 Apr 12 06:41:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 254/762] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:41:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Creating event network-changed:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:41:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042959 Apr 12 06:41:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 255/763] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:41:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "name": "network-vif-plugged", "status": "completed", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Creating event network-vif-plugged:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:41:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043463 Apr 12 06:41:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 255/764] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:41:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "name": "network-vif-plugged", "status": "completed", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Creating event network-vif-plugged:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:41:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Apr 12 06:41:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 255/765] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:41:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] HTTP exception thrown: Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 could not be found. Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Request method failure captured: Apr 12 06:41:46 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 HTTP/1.1 Apr 12 06:41:46 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:41:46 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:41:46 user devstack@n-api.service[62041]: Connection: close Apr 12 06:41:46 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:41:46 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:41:46 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:41:46 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:41:46 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlDH1pnbm_nkUn8l3svJLMUUUzgNC5jJgJMl2_Cv76u2XNNp2VHoHE4Hh8K2ppfB2I40_B3FVphWwWCqD7XpVNeS2TIaFGlNAGzxDPKV_1Czfcl8M9oeugtC1IokvZMbSOV1JOnabfJ9jVvLvM0lIVLn9hDebV3lKlevBsTKE6eeg1w Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Project-Id: aa21d19689b343dd935505ba458dd6af Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerStableDeviceRescueTest-88660584 Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa21d19689b343dd935505ba458dd6af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aa21d19689b343dd935505ba458dd6af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa21d19689b343dd935505ba458dd6af"}]}] Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerStableDeviceRescueTest-88660584 Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Tenant-Id: aa21d19689b343dd935505ba458dd6af Apr 12 06:41:46 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-88660584 Apr 12 06:41:46 user devstack@n-api.service[62041]: X-User: tempest-ServerStableDeviceRescueTest-88660584-project-member Apr 12 06:41:46 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:41:46 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:41:46 user devstack@n-api.service[62041]: X-User-Id: 0ed0f651f79846138e3be8f312b3188f Apr 12 06:41:46 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerStableDeviceRescueTest-88660584-project-member Apr 12 06:41:46 user devstack@n-api.service[62041]: method: > Apr 12 06:41:46 user devstack@n-api.service[62041]: exception: Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 could not be found. Apr 12 06:41:46 user devstack@n-api.service[62041]: action_args: {'id': '4bef2d11-2dfe-47cb-a1ed-3331038ecd99'} Apr 12 06:41:46 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 could not be found. Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 could not be found. Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 could not be found. Apr 12 06:41:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:41:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Returning 404 to user: Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:41:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-78ca0c0e-4775-49d2-b4f0-275306b4c93d tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99" status: 404 len: 111 microversion: 2.1 time: 0.030209 Apr 12 06:41:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 256/766] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:41:46 2023] GET /compute/v2.1/servers/4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:41:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-00f55b95-ff7c-4c9a-9ff0-ea640d5989d2 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Calling method '.version_select at 0x7fd24e0eaf80>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-00f55b95-ff7c-4c9a-9ff0-ea640d5989d2 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966536347" status: 202 len: 0 microversion: 2.1 time: 0.043912 Apr 12 06:41:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 256/767] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 06:41:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966536347 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:52 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:52 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/action" status: 204 len: 0 microversion: 2.1 time: 0.089844 Apr 12 06:41:52 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 256/768] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:41:52 2023] POST /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:41:52 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:41:52 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-070f3b67-bc44-4400-84e1-773fbce0c6ad tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1554 microversion: 2.1 time: 0.165690 Apr 12 06:41:52 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 257/769] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:41:52 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:42:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-69068700", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f"}]}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:42:12 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] validate_networks() for [('c85a8ae1-c736-4edc-ba2d-0a71237adc9f', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting quotas for project af34529636fc4221921028f93b1c381a. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting quotas for user 8546fd1ed08b4e88a945e73347be38c2 and project af34529636fc4221921028f93b1c381a. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:42:13 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:42:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.585164 Apr 12 06:42:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 257/770] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:42:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:42:13 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:13 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-63694bdd-6723-4dca-b479-e74193b5081c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:13 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-63694bdd-6723-4dca-b479-e74193b5081c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:13 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-63694bdd-6723-4dca-b479-e74193b5081c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:42:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-63694bdd-6723-4dca-b479-e74193b5081c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8" status: 200 len: 1211 microversion: 2.1 time: 0.186992 Apr 12 06:42:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 257/771] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:42:13 2023] GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8 => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:42:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb5bae3-4c69-429d-b71c-8dee3437aff8", "tag": "8cec16af-061e-4a14-bf55-f33bd17192e7"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:42:16 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:16 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=20 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Creating event network-changed:8cec16af-061e-4a14-bf55-f33bd17192e7 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 on user Apr 12 06:42:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034685 Apr 12 06:42:16 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 258/772] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:42:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb5bae3-4c69-429d-b71c-8dee3437aff8", "name": "network-vif-plugged", "status": "completed", "tag": "8cec16af-061e-4a14-bf55-f33bd17192e7"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:42:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Creating event network-vif-plugged:8cec16af-061e-4a14-bf55-f33bd17192e7 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 on user Apr 12 06:42:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031243 Apr 12 06:42:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 258/773] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb5bae3-4c69-429d-b71c-8dee3437aff8", "name": "network-vif-plugged", "status": "completed", "tag": "8cec16af-061e-4a14-bf55-f33bd17192e7"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:42:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Creating event network-vif-plugged:8cec16af-061e-4a14-bf55-f33bd17192e7 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 on user Apr 12 06:42:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034568 Apr 12 06:42:20 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 258/774] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:42:24 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:42:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-5735eb3b-2b0d-49a5-9671-35f232f8099c tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1770 microversion: 2.87 time: 0.166636 Apr 12 06:42:24 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 259/775] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:42:24 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1770 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:42:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:28 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:42:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-624e97ed-5ae5-45b8-807c-3aaf708d5e2b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 200 len: 1546 microversion: 2.1 time: 0.265977 Apr 12 06:42:28 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 259/776] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:42:27 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 1546 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:35 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e1fa5d4f-5dbc-478c-8eae-7954a6c43b41 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.101410 Apr 12 06:42:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 259/777] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:42:35 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-interface => generated 283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:42:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:36 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:36 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Creating event network-changed:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:42:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042910 Apr 12 06:42:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 260/778] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:42:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:36 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'services' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:42:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments/4e3910db-ed08-4a5a-bb85-48c49eccbf9a" status: 202 len: 0 microversion: 2.1 time: 0.256964 Apr 12 06:42:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 260/779] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:42:36 2023] DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments/4e3910db-ed08-4a5a-bb85-48c49eccbf9a => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-546c50d3-75ca-437c-ba2f-226f0725d527 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047071 Apr 12 06:42:36 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 260/780] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:42:36 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:42:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Creating event network-changed:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:42:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041104 Apr 12 06:42:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 261/781] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:42:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:42:42 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:42:42 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-64497b7f-261d-47ea-9690-40cfa96a54e7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1546 microversion: 2.1 time: 0.180855 Apr 12 06:42:42 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 261/782] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:42:42 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-9b209ae5-3e91-47e1-8c06-dc3c8104e006 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8" status: 200 len: 1493 microversion: 2.1 time: 0.153589 Apr 12 06:43:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 261/783] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:43:03 2023] GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8 => generated 1493 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:24 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:43:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 204 len: 0 microversion: 2.87 time: 0.398750 Apr 12 06:43:24 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 262/784] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:43:24 2023] DELETE /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:25 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:25 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:25 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:25 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0ebad6c5-bdab-44fb-8ad7-2d6f6c00933b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 200 len: 1776 microversion: 2.87 time: 0.293900 Apr 12 06:43:25 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 262/785] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:43:24 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 1776 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:43:25 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:25 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:25 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-unplugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Creating event network-vif-unplugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:43:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143500 Apr 12 06:43:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 262/786] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:43:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-deleted", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] Creating event network-vif-deleted:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:43:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087699 Apr 12 06:43:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 263/787] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:26 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:26 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-557c13db-a6cc-4955-b2fb-9a9874d1afd2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045385 Apr 12 06:43:26 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 263/788] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:43:26 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:26 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:43:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 204 len: 0 microversion: 2.1 time: 0.256228 Apr 12 06:43:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 263/789] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:43:26 2023] DELETE /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207359ea-0c81-46aa-a638-276957be0112", "name": "network-vif-plugged", "status": "completed", "tag": "b9933569-0e24-4acb-b85d-ccb1eb9c5721"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:27 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-afb89a25-0956-4079-93bc-a6679605ba08 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 200 len: 1674 microversion: 2.1 time: 0.204276 Apr 12 06:43:27 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 264/790] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:43:27 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:43:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Creating event network-vif-plugged:b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance 207359ea-0c81-46aa-a638-276957be0112 on user Apr 12 06:43:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038503 Apr 12 06:43:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 264/791] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5921d121-b23e-499c-8916-3e554c855433 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100803 Apr 12 06:43:28 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 264/792] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 06:43:28 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-interface => generated 283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}, {"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-plugged", "status": "completed", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Creating event network-vif-unplugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:43:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Creating event network-vif-plugged:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:43:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030621 Apr 12 06:43:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 265/793] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Creating event network-changed:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:43:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-86e0a286-0d20-4fb1-a739-36caedcbe480 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/ips" status: 200 len: 109 microversion: 2.1 time: 0.046950 Apr 12 06:43:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 265/794] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:43:29 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/ips => generated 109 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104698 Apr 12 06:43:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 265/795] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9", "name": "network-vif-deleted", "tag": "4d362992-cbb4-4530-b971-86688508274f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] Creating event network-vif-deleted:4d362992-cbb4-4530-b971-86688508274f for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 on user Apr 12 06:43:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038381 Apr 12 06:43:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 266/796] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:43:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19ab1977-9c7a-4434-8e2c-2b9b0899eeb0"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308292 Apr 12 06:43:31 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 266/797] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:43:30 2023] POST /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:37 user devstack@n-api.service[62042]: DEBUG nova.objects.instance [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'services' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=62042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:43:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments/19ab1977-9c7a-4434-8e2c-2b9b0899eeb0" status: 202 len: 0 microversion: 2.1 time: 0.203974 Apr 12 06:43:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 266/798] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:43:37 2023] DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments/19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a13008a7-8507-4699-b159-de4e76b2b6f8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042961 Apr 12 06:43:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 267/799] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:43:37 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:43:42 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:42 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-46e910e1-1fcb-4e99-a30e-feec6ce1a009 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1546 microversion: 2.1 time: 0.324008 Apr 12 06:43:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 267/800] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:43:42 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1546 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "POST /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/action" status: 200 len: 28493 microversion: 2.1 time: 0.230843 Apr 12 06:43:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 267/801] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:43:43 2023] POST /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8/action => generated 28493 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:43:43 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:43:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c488cc1b-21bd-46db-8584-f58e88e5db74 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86" status: 200 len: 1539 microversion: 2.1 time: 0.146123 Apr 12 06:43:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 268/802] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:43:43 2023] GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9004e518-c5eb-40fa-8afd-932d1d8b1625", "device": "/dev/vdb"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:03 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:04 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338674 Apr 12 06:44:04 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 268/803] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:44:03 2023] POST /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=14 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HTTP exception thrown: Instance 207359ea-0c81-46aa-a638-276957be0112 could not be found. Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Request method failure captured: Apr 12 06:44:15 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 HTTP/1.1 Apr 12 06:44:15 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:44:15 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:44:15 user devstack@n-api.service[62042]: Connection: close Apr 12 06:44:15 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:44:15 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:44:15 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:44:15 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:44:15 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk8NZh5cpkCX1ZoLZ8wZDH31-YYdV15CsqxZXJ_6qHwgba9fAmfhcLqkRe_sf1KH3FVDMOTMX9K3u1KD2bt_8XboipxsPkm3n2wiFW0-EI2iq1jwMZD26fnIv-XzdUMTH7l1ipiT-h83r7-Wlvi1-0bNPix8_k5mivwSPVbnjLNQicg Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Project-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}] Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Tenant-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:44:15 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:44:15 user devstack@n-api.service[62042]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:44:15 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:44:15 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:44:15 user devstack@n-api.service[62042]: X-User-Id: 2e5e4455358643b8830ce8c96aad5aad Apr 12 06:44:15 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:44:15 user devstack@n-api.service[62042]: method: > Apr 12 06:44:15 user devstack@n-api.service[62042]: exception: Instance 207359ea-0c81-46aa-a638-276957be0112 could not be found. Apr 12 06:44:15 user devstack@n-api.service[62042]: action_args: {'id': '207359ea-0c81-46aa-a638-276957be0112'} Apr 12 06:44:15 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207359ea-0c81-46aa-a638-276957be0112 could not be found. Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207359ea-0c81-46aa-a638-276957be0112 could not be found. Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207359ea-0c81-46aa-a638-276957be0112 could not be found. Apr 12 06:44:15 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Returning 404 to user: Instance 207359ea-0c81-46aa-a638-276957be0112 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:44:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4015f5f8-900a-477a-a9ce-c46d6562c3e7 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112" status: 404 len: 111 microversion: 2.87 time: 0.035059 Apr 12 06:44:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 268/804] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:44:15 2023] GET /compute/v2.1/servers/207359ea-0c81-46aa-a638-276957be0112 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:44:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14" status: 204 len: 0 microversion: 2.87 time: 0.135359 Apr 12 06:44:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 269/805] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:44:15 2023] DELETE /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:15 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4a4dd3bc-d854-417f-a1af-d33efa91aa4f tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14" status: 200 len: 1698 microversion: 2.87 time: 0.208306 Apr 12 06:44:15 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 269/806] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:44:15 2023] GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 => generated 1698 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-unplugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Creating event network-vif-unplugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:44:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050019 Apr 12 06:44:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 269/807] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-deleted", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] Creating event network-vif-deleted:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:44:16 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Apr 12 06:44:16 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 270/808] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] HTTP exception thrown: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 could not be found. Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Request method failure captured: Apr 12 06:44:17 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 HTTP/1.1 Apr 12 06:44:17 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:44:17 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:44:17 user devstack@n-api.service[62040]: Connection: close Apr 12 06:44:17 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:44:17 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:44:17 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:44:17 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:44:17 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk-JeNy21s7Rknzj_nYv8cM8VvntK8qM6XljS0AYLMp6b6peVEx3_8-7Fdr60hQbsU-v6H8YO8JJkx117AZ6zzEi9eNJl_J-BtRjuUxbU3T67SujETdbUCYBSn16znapXlFxKFgQZopvXzgp3fxTKXFhZD7CaHJqa3SLnDmhazrsekM Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Project-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}] Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Tenant-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:44:17 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:44:17 user devstack@n-api.service[62040]: X-User: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:44:17 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:44:17 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:44:17 user devstack@n-api.service[62040]: X-User-Id: dc8e6af1db834409a4880040a5ef6a5a Apr 12 06:44:17 user devstack@n-api.service[62040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:44:17 user devstack@n-api.service[62040]: method: > Apr 12 06:44:17 user devstack@n-api.service[62040]: exception: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 could not be found. Apr 12 06:44:17 user devstack@n-api.service[62040]: action_args: {'id': '8bd6a08b-ef82-4019-b5d3-7e84cb241eb9'} Apr 12 06:44:17 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 could not be found. Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 could not be found. Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 could not be found. Apr 12 06:44:17 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:44:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Returning 404 to user: Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:44:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-290952ef-ab8d-4223-b222-dfb7259c946d tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" status: 404 len: 111 microversion: 2.1 time: 0.031302 Apr 12 06:44:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 270/809] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:44:17 2023] GET /compute/v2.1/servers/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:44:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a465d55c-1a9c-45ec-be7c-cda174227d25 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '.version_select at 0x7fd24e1a4940>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a465d55c-1a9c-45ec-be7c-cda174227d25 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4832485" status: 202 len: 0 microversion: 2.1 time: 0.027366 Apr 12 06:44:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 270/810] 10.0.0.210 () {62 vars in 1289 bytes} [Wed Apr 12 06:44:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4832485 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:44:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-plugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}, {"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-plugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}, {"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-plugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}, {"server_uuid": "faa2ad52-9528-4013-ad20-4a1d636aed14", "name": "network-vif-plugged", "status": "completed", "tag": "07855ce5-9604-4b55-86e2-1c4dfe89d70f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Creating event network-vif-plugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:44:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Creating event network-vif-plugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:44:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Creating event network-vif-plugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:44:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Creating event network-vif-plugged:07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance faa2ad52-9528-4013-ad20-4a1d636aed14 on user Apr 12 06:44:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032097 Apr 12 06:44:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 271/811] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:44:22 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 204 len: 0 microversion: 2.1 time: 0.115796 Apr 12 06:44:22 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 271/812] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:44:22 2023] DELETE /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:22 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:22 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-ff11c634-d2ce-46ac-a3a5-c673787c4fe4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 200 len: 1494 microversion: 2.1 time: 0.152594 Apr 12 06:44:22 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 271/813] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:44:22 2023] GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 1494 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:44:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-unplugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Creating event network-vif-unplugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:44:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028155 Apr 12 06:44:22 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 272/814] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:23 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'services' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:44:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8/os-volume_attachments/9004e518-c5eb-40fa-8afd-932d1d8b1625" status: 202 len: 0 microversion: 2.1 time: 0.209534 Apr 12 06:44:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 272/815] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:44:22 2023] DELETE /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8/os-volume_attachments/9004e518-c5eb-40fa-8afd-932d1d8b1625 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:23 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:44:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8" status: 204 len: 0 microversion: 2.1 time: 0.141640 Apr 12 06:44:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 272/816] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:44:23 2023] DELETE /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:23 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b6ce9e61-9ee0-458a-932d-29d60a0cb3db tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8" status: 200 len: 1545 microversion: 2.1 time: 0.161520 Apr 12 06:44:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 273/817] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:44:23 2023] GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8 => generated 1545 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:44:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-deleted", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] Creating event network-vif-deleted:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:44:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042459 Apr 12 06:44:24 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 273/818] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64aff93-15fa-4520-b6ac-cdcacb49478e", "name": "network-vif-plugged", "status": "completed", "tag": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Creating event network-vif-plugged:6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance c64aff93-15fa-4520-b6ac-cdcacb49478e on user Apr 12 06:44:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038794 Apr 12 06:44:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 273/819] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:25 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb5bae3-4c69-429d-b71c-8dee3437aff8", "name": "network-vif-unplugged", "status": "completed", "tag": "8cec16af-061e-4a14-bf55-f33bd17192e7"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Creating event network-vif-unplugged:8cec16af-061e-4a14-bf55-f33bd17192e7 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 on user Apr 12 06:44:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030144 Apr 12 06:44:25 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 274/820] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb5bae3-4c69-429d-b71c-8dee3437aff8", "name": "network-vif-deleted", "tag": "8cec16af-061e-4a14-bf55-f33bd17192e7"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] Creating event network-vif-deleted:8cec16af-061e-4a14-bf55-f33bd17192e7 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 on user Apr 12 06:44:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028181 Apr 12 06:44:26 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 274/821] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb5bae3-4c69-429d-b71c-8dee3437aff8", "name": "network-vif-plugged", "status": "completed", "tag": "8cec16af-061e-4a14-bf55-f33bd17192e7"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Creating event network-vif-plugged:8cec16af-061e-4a14-bf55-f33bd17192e7 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 on user Apr 12 06:44:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030332 Apr 12 06:44:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 274/822] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0a16cd84-dac1-496f-98f6-01130712e6dc tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042037 Apr 12 06:44:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 275/823] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:44:28 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:44:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 204 len: 0 microversion: 2.1 time: 0.145955 Apr 12 06:44:28 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 275/824] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:44:28 2023] DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e6dc5c28-970f-4360-9f41-4e3a42852c5d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 200 len: 1670 microversion: 2.1 time: 0.154997 Apr 12 06:44:28 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 275/825] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:44:28 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "name": "network-vif-unplugged", "status": "completed", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Creating event network-vif-unplugged:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:44:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030904 Apr 12 06:44:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 276/826] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:44:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "name": "network-vif-plugged", "status": "completed", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}, {"server_uuid": "c6bc228c-8c66-45e3-9140-1dd5d321b2c8", "name": "network-vif-deleted", "tag": "83ad8682-5a06-482a-969b-965968a4a243"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Creating event network-vif-plugged:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:44:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Creating event network-vif-deleted:83ad8682-5a06-482a-969b-965968a4a243 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 on user Apr 12 06:44:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029950 Apr 12 06:44:30 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 276/827] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:44:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 204 len: 0 microversion: 2.1 time: 0.110799 Apr 12 06:44:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 276/828] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:44:43 2023] DELETE /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:44 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:44:44 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-99b4db4c-43a6-4162-9b66-3ac444d8bebd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 200 len: 1552 microversion: 2.1 time: 0.186058 Apr 12 06:44:44 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 277/829] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:44:43 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:44:44 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:44 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:44:44 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-unplugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:44 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Creating event network-vif-unplugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:44:44 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036179 Apr 12 06:44:44 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 277/830] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:44:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-plugged", "status": "completed", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}, {"server_uuid": "51402ffe-ef35-41a3-811b-5a00788a13d8", "name": "network-vif-deleted", "tag": "764f8775-3274-4813-97b0-4514b81b7c2e"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:44:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:44:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:44:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:44:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Creating event network-vif-plugged:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:44:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Creating event network-vif-deleted:764f8775-3274-4813-97b0-4514b81b7c2e for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 on user Apr 12 06:44:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034401 Apr 12 06:44:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 277/831] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HTTP exception thrown: Instance faa2ad52-9528-4013-ad20-4a1d636aed14 could not be found. Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Request method failure captured: Apr 12 06:45:05 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 HTTP/1.1 Apr 12 06:45:05 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:05 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:05 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:05 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:05 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:05 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:05 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:05 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk8NZh5cpkCX1ZoLZ8wZDH31-YYdV15CsqxZXJ_6qHwgba9fAmfhcLqkRe_sf1KH3FVDMOTMX9K3u1KD2bt_8XboipxsPkm3n2wiFW0-EI2iq1jwMZD26fnIv-XzdUMTH7l1ipiT-h83r7-Wlvi1-0bNPix8_k5mivwSPVbnjLNQicg Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Project-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}] Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Tenant-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:45:05 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:45:05 user devstack@n-api.service[62041]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:45:05 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:05 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:05 user devstack@n-api.service[62041]: X-User-Id: 2e5e4455358643b8830ce8c96aad5aad Apr 12 06:45:05 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:45:05 user devstack@n-api.service[62041]: method: > Apr 12 06:45:05 user devstack@n-api.service[62041]: exception: Instance faa2ad52-9528-4013-ad20-4a1d636aed14 could not be found. Apr 12 06:45:05 user devstack@n-api.service[62041]: action_args: {'id': 'faa2ad52-9528-4013-ad20-4a1d636aed14'} Apr 12 06:45:05 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa2ad52-9528-4013-ad20-4a1d636aed14 could not be found. Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa2ad52-9528-4013-ad20-4a1d636aed14 could not be found. Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa2ad52-9528-4013-ad20-4a1d636aed14 could not be found. Apr 12 06:45:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Returning 404 to user: Instance faa2ad52-9528-4013-ad20-4a1d636aed14 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d1be7d7f-0a70-4bec-b139-84d112f3e87a tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14" status: 404 len: 111 microversion: 2.87 time: 0.032904 Apr 12 06:45:05 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 278/832] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:45:05 2023] GET /compute/v2.1/servers/faa2ad52-9528-4013-ad20-4a1d636aed14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:05 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:45:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 204 len: 0 microversion: 2.87 time: 0.108094 Apr 12 06:45:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 278/833] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:45:05 2023] DELETE /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:45:05 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:05 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:05 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:05 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:06 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:06 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d9416c37-785d-4b09-b351-8130dc2670c3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 200 len: 1776 microversion: 2.87 time: 0.182750 Apr 12 06:45:06 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 278/834] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:45:05 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 1776 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:45:06 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-unplugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:06 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:06 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:06 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:06 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Creating event network-vif-unplugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:45:06 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031157 Apr 12 06:45:06 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 279/835] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:08 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-plugged", "status": "completed", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}, {"server_uuid": "ebb36f74-c4a3-4108-949d-1fb8918f9a8c", "name": "network-vif-deleted", "tag": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:08 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Creating event network-vif-plugged:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:45:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Creating event network-vif-deleted:0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c on user Apr 12 06:45:08 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038048 Apr 12 06:45:08 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 279/836] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] HTTP exception thrown: Instance c64aff93-15fa-4520-b6ac-cdcacb49478e could not be found. Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Request method failure captured: Apr 12 06:45:12 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e HTTP/1.1 Apr 12 06:45:12 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:12 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:12 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:12 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:12 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:12 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:12 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:12 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk-JeNy21s7Rknzj_nYv8cM8VvntK8qM6XljS0AYLMp6b6peVEx3_8-7Fdr60hQbsU-v6H8YO8JJkx117AZ6zzEi9eNJl_J-BtRjuUxbU3T67SujETdbUCYBSn16znapXlFxKFgQZopvXzgp3fxTKXFhZD7CaHJqa3SLnDmhazrsekM Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Project-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}] Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Tenant-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:45:12 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:45:12 user devstack@n-api.service[62042]: X-User: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:45:12 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:12 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:12 user devstack@n-api.service[62042]: X-User-Id: dc8e6af1db834409a4880040a5ef6a5a Apr 12 06:45:12 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:45:12 user devstack@n-api.service[62042]: method: > Apr 12 06:45:12 user devstack@n-api.service[62042]: exception: Instance c64aff93-15fa-4520-b6ac-cdcacb49478e could not be found. Apr 12 06:45:12 user devstack@n-api.service[62042]: action_args: {'id': 'c64aff93-15fa-4520-b6ac-cdcacb49478e'} Apr 12 06:45:12 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64aff93-15fa-4520-b6ac-cdcacb49478e could not be found. Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64aff93-15fa-4520-b6ac-cdcacb49478e could not be found. Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64aff93-15fa-4520-b6ac-cdcacb49478e could not be found. Apr 12 06:45:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Returning 404 to user: Instance c64aff93-15fa-4520-b6ac-cdcacb49478e could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-eef3a1a8-6a30-4101-9f88-02e103594a80 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e" status: 404 len: 111 microversion: 2.1 time: 0.140906 Apr 12 06:45:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 279/837] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:12 2023] GET /compute/v2.1/servers/c64aff93-15fa-4520-b6ac-cdcacb49478e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:12 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:45:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 204 len: 0 microversion: 2.1 time: 0.105874 Apr 12 06:45:13 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 280/838] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:12 2023] DELETE /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:13 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:13 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-unplugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:13 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6e087c97-089a-4c4b-913c-981071ca76f2 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 200 len: 1509 microversion: 2.1 time: 0.193780 Apr 12 06:45:13 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 280/839] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:13 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:45:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:13 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Creating event network-vif-unplugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:45:13 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036368 Apr 12 06:45:13 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 280/840] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] HTTP exception thrown: Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 could not be found. Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Request method failure captured: Apr 12 06:45:13 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8 HTTP/1.1 Apr 12 06:45:13 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:13 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:13 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:13 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:13 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:13 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:13 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:13 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlLAwk9WwI_YWGMBxxHqrkJ3qKlWZvJA29x-LEgjPdzb9oA61H1zKzi5x-BlmGTj0mB_0JxPsyu7CP8AAhp2jvLVlX7e02vIIbVFoIeUVnuD0w8XokaWPIQjkqYYdjheu13KXMt8Q634sr1EWmNX7CK-oXjVyu0hgrGsRHS9qaRDj-k Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Project-Id: af34529636fc4221921028f93b1c381a Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2015355536 Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34529636fc4221921028f93b1c381a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af34529636fc4221921028f93b1c381a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34529636fc4221921028f93b1c381a"}]}] Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Tenant: tempest-VolumesSnapshotTestJSON-2015355536 Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Tenant-Id: af34529636fc4221921028f93b1c381a Apr 12 06:45:13 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2015355536 Apr 12 06:45:13 user devstack@n-api.service[62041]: X-User: tempest-VolumesSnapshotTestJSON-2015355536-project-member Apr 12 06:45:13 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:13 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:13 user devstack@n-api.service[62041]: X-User-Id: 8546fd1ed08b4e88a945e73347be38c2 Apr 12 06:45:13 user devstack@n-api.service[62041]: X-User-Name: tempest-VolumesSnapshotTestJSON-2015355536-project-member Apr 12 06:45:13 user devstack@n-api.service[62041]: method: > Apr 12 06:45:13 user devstack@n-api.service[62041]: exception: Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 could not be found. Apr 12 06:45:13 user devstack@n-api.service[62041]: action_args: {'id': 'bbb5bae3-4c69-429d-b71c-8dee3437aff8'} Apr 12 06:45:13 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 could not be found. Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 could not be found. Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 could not be found. Apr 12 06:45:13 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Returning 404 to user: Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-dd091d44-96bb-4d82-8db1-364acf44ef8c tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8" status: 404 len: 111 microversion: 2.1 time: 0.028520 Apr 12 06:45:13 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 281/841] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:13 2023] GET /compute/v2.1/servers/bbb5bae3-4c69-429d-b71c-8dee3437aff8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:14 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-deleted", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:14 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] Creating event network-vif-deleted:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:45:14 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042594 Apr 12 06:45:14 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 281/842] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5364688b-cc08-4407-94f5-974846ae7bb8", "name": "network-vif-plugged", "status": "completed", "tag": "92e5c952-1e00-4dde-8dcc-dc876149d896"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Creating event network-vif-plugged:92e5c952-1e00-4dde-8dcc-dc876149d896 for instance 5364688b-cc08-4407-94f5-974846ae7bb8 on user Apr 12 06:45:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028929 Apr 12 06:45:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 281/843] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:18 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 HTTP/1.1 Apr 12 06:45:18 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:18 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:18 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:18 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:18 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:18 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:18 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:18 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:18 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:18 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:18 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:18 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:18 user devstack@n-api.service[62041]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:18 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:18 user devstack@n-api.service[62041]: method: > Apr 12 06:45:18 user devstack@n-api.service[62041]: exception: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:18 user devstack@n-api.service[62041]: action_args: {'id': 'c6bc228c-8c66-45e3-9140-1dd5d321b2c8'} Apr 12 06:45:18 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:18 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:18 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7ead4fe1-7330-4368-8034-db975b7c749b tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 404 len: 111 microversion: 2.1 time: 0.027323 Apr 12 06:45:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 282/844] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:18 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:18 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e27cb5bd-dbd4-4338-9024-920d22dea430 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '.version_select at 0x7fd24dbcf0a0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:18 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e27cb5bd-dbd4-4338-9024-920d22dea430 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165194356" status: 202 len: 0 microversion: 2.1 time: 0.024311 Apr 12 06:45:18 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 282/845] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:45:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165194356 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:45:20 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1542125927", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "networks": [{"uuid": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f"}]}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:20 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] validate_networks() for [('c85a8ae1-c736-4edc-ba2d-0a71237adc9f', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting quotas for project af34529636fc4221921028f93b1c381a. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting quotas for user 8546fd1ed08b4e88a945e73347be38c2 and project af34529636fc4221921028f93b1c381a. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:45:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.520542 Apr 12 06:45:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 282/846] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:45:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:45:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0ddb109f-f6ab-4f20-b33d-81b6ec2f5811 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:21 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-0ddb109f-f6ab-4f20-b33d-81b6ec2f5811 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:21 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-0ddb109f-f6ab-4f20-b33d-81b6ec2f5811 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0ddb109f-f6ab-4f20-b33d-81b6ec2f5811 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e" status: 200 len: 1213 microversion: 2.1 time: 0.071777 Apr 12 06:45:21 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 283/847] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:21 2023] GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:21 user devstack@n-api.service[62040]: request: DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 HTTP/1.1 Apr 12 06:45:21 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:45:21 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:45:21 user devstack@n-api.service[62040]: Connection: close Apr 12 06:45:21 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:45:21 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:45:21 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:45:21 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:45:21 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:21 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:21 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:21 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:45:21 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:45:21 user devstack@n-api.service[62040]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:21 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:21 user devstack@n-api.service[62040]: method: > Apr 12 06:45:21 user devstack@n-api.service[62040]: exception: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62040]: action_args: {'id': 'c6bc228c-8c66-45e3-9140-1dd5d321b2c8'} Apr 12 06:45:21 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1070c91c-d589-4f03-aa3a-0954742380e7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 404 len: 111 microversion: 2.1 time: 0.299898 Apr 12 06:45:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 283/848] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:21 2023] DELETE /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 111 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:21 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 HTTP/1.1 Apr 12 06:45:21 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:21 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:21 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:21 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:21 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:21 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:21 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:21 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:21 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:21 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:21 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:21 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:21 user devstack@n-api.service[62042]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:21 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:21 user devstack@n-api.service[62042]: method: > Apr 12 06:45:21 user devstack@n-api.service[62042]: exception: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62042]: action_args: {'id': 'c6bc228c-8c66-45e3-9140-1dd5d321b2c8'} Apr 12 06:45:21 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. Apr 12 06:45:21 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-10a0884f-396d-457c-918f-40fb3d27ce2d tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8" status: 404 len: 111 microversion: 2.1 time: 0.032013 Apr 12 06:45:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 283/849] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:21 2023] GET /compute/v2.1/servers/c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f055ae-909d-4fda-a2d5-0f4aef77928e", "tag": "2923dc36-c11b-43e4-afed-fb46cc033110"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Creating event network-changed:2923dc36-c11b-43e4-afed-fb46cc033110 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e on user Apr 12 06:45:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031499 Apr 12 06:45:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 284/850] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:23 user devstack@n-api.service[62040]: request: DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 HTTP/1.1 Apr 12 06:45:23 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:45:23 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:45:23 user devstack@n-api.service[62040]: Connection: close Apr 12 06:45:23 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:45:23 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:45:23 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:45:23 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:45:23 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:23 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:23 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:23 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:45:23 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:45:23 user devstack@n-api.service[62040]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:23 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:23 user devstack@n-api.service[62040]: method: > Apr 12 06:45:23 user devstack@n-api.service[62040]: exception: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:23 user devstack@n-api.service[62040]: action_args: {'id': 'f93121be-8fbc-4b92-856a-64bf9f192532'} Apr 12 06:45:23 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:23 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e6bab445-09e3-4765-ba26-2ba1d313ea3c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 404 len: 111 microversion: 2.1 time: 0.040339 Apr 12 06:45:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 284/851] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:23 2023] DELETE /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:24 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 HTTP/1.1 Apr 12 06:45:24 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:24 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:24 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:24 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:24 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:24 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:24 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:24 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:24 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:24 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:24 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:24 user devstack@n-api.service[62042]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:24 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:24 user devstack@n-api.service[62042]: method: > Apr 12 06:45:24 user devstack@n-api.service[62042]: exception: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:24 user devstack@n-api.service[62042]: action_args: {'id': 'f93121be-8fbc-4b92-856a-64bf9f192532'} Apr 12 06:45:24 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. Apr 12 06:45:24 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance f93121be-8fbc-4b92-856a-64bf9f192532 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-855c3cf8-82ad-4f45-a947-07084e0b963a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532" status: 404 len: 111 microversion: 2.1 time: 0.030996 Apr 12 06:45:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 284/852] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:23 2023] GET /compute/v2.1/servers/f93121be-8fbc-4b92-856a-64bf9f192532 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:24 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c HTTP/1.1 Apr 12 06:45:24 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:24 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:24 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:24 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:24 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:24 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:24 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:24 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:24 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:24 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:24 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:24 user devstack@n-api.service[62041]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:24 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:24 user devstack@n-api.service[62041]: method: > Apr 12 06:45:24 user devstack@n-api.service[62041]: exception: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62041]: action_args: {'id': '143e1e28-20bd-4cdc-b9e4-c199a3d42e3c'} Apr 12 06:45:24 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-29b5780b-9e8b-4e18-89cb-03c2ce6552f0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 404 len: 111 microversion: 2.1 time: 0.031480 Apr 12 06:45:24 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 285/853] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:24 2023] DELETE /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:24 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c HTTP/1.1 Apr 12 06:45:24 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:45:24 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:45:24 user devstack@n-api.service[62040]: Connection: close Apr 12 06:45:24 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:45:24 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:45:24 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:45:24 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:45:24 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:24 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:24 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:24 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:45:24 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:45:24 user devstack@n-api.service[62040]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:24 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:24 user devstack@n-api.service[62040]: method: > Apr 12 06:45:24 user devstack@n-api.service[62040]: exception: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62040]: action_args: {'id': '143e1e28-20bd-4cdc-b9e4-c199a3d42e3c'} Apr 12 06:45:24 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. Apr 12 06:45:24 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-52415cb6-88e0-42b0-afbe-41b723a413d3 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" status: 404 len: 111 microversion: 2.1 time: 0.028539 Apr 12 06:45:24 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 285/854] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:24 2023] GET /compute/v2.1/servers/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 06:45:25 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f055ae-909d-4fda-a2d5-0f4aef77928e", "name": "network-vif-plugged", "status": "completed", "tag": "2923dc36-c11b-43e4-afed-fb46cc033110"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:25 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Creating event network-vif-plugged:2923dc36-c11b-43e4-afed-fb46cc033110 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e on user Apr 12 06:45:25 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Apr 12 06:45:25 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 285/855] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:26 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 HTTP/1.1 Apr 12 06:45:26 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:26 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:26 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:26 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:26 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:26 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:26 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:26 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:26 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:26 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:26 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:26 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:26 user devstack@n-api.service[62041]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:26 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:26 user devstack@n-api.service[62041]: method: > Apr 12 06:45:26 user devstack@n-api.service[62041]: exception: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62041]: action_args: {'id': 'cb572c1a-2901-4b09-920d-e3e0da7765b2'} Apr 12 06:45:26 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-70288434-29e7-4e13-846b-950ab55a3789 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 404 len: 111 microversion: 2.1 time: 0.041698 Apr 12 06:45:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 286/856] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:26 2023] DELETE /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HTTP exception thrown: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Request method failure captured: Apr 12 06:45:26 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 HTTP/1.1 Apr 12 06:45:26 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:45:26 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:45:26 user devstack@n-api.service[62040]: Connection: close Apr 12 06:45:26 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:45:26 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:45:26 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:45:26 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:45:26 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlA3AxCBI8TOp--lryM-M8qledJ4ZMWhTgdLkEAqkAiNxpZz6ZRHDe4qi5IE_kZ24AYNjsw3LBhYhFmUSg4kv04JyUCePfE6Fts23QAlfB3I-1fYrbhfyA594HCfWDkg5v0pC53lp-q4BlQlJ5vxuXxrWk2nFcA-ayEmBDQhwJ2ZyGg Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Project-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b267dce1303d451ca307eeaa38baf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b267dce1303d451ca307eeaa38baf685"}]}] Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Tenant-Id: b267dce1303d451ca307eeaa38baf685 Apr 12 06:45:26 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1905486920 Apr 12 06:45:26 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:26 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:45:26 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:45:26 user devstack@n-api.service[62040]: X-User-Id: d6cd1f8b3c0d42298f6f4a303f1251ec Apr 12 06:45:26 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeNegativeTest-1905486920-project-member Apr 12 06:45:26 user devstack@n-api.service[62040]: method: > Apr 12 06:45:26 user devstack@n-api.service[62040]: exception: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62040]: action_args: {'id': 'cb572c1a-2901-4b09-920d-e3e0da7765b2'} Apr 12 06:45:26 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. Apr 12 06:45:26 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:26 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Returning 404 to user: Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:26 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3828b008-515a-4236-bda3-022ca7adc739 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2" status: 404 len: 111 microversion: 2.1 time: 0.031184 Apr 12 06:45:26 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 286/857] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:26 2023] GET /compute/v2.1/servers/cb572c1a-2901-4b09-920d-e3e0da7765b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f055ae-909d-4fda-a2d5-0f4aef77928e", "name": "network-vif-plugged", "status": "completed", "tag": "2923dc36-c11b-43e4-afed-fb46cc033110"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Creating event network-vif-plugged:2923dc36-c11b-43e4-afed-fb46cc033110 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e on user Apr 12 06:45:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036173 Apr 12 06:45:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 286/858] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:45:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Action: 'create', calling method: .version_select at 0x7fd24db785e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-870682519"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0d6ba1d5-1ded-4b6a-a689-e3884f604566 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.590685 Apr 12 06:45:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 287/859] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 06:45:30 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 592 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 06:45:31 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c63aa4b0-aea1-4905-afd4-41e38026a839 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbce8c0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c63aa4b0-aea1-4905-afd4-41e38026a839 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 200 len: 344 microversion: 2.1 time: 0.051746 Apr 12 06:45:31 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 287/860] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:31 2023] GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:32 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:32 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c10d9498-f406-4952-8952-141e66e88e08 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24eaf1ab0>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c10d9498-f406-4952-8952-141e66e88e08 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 200 len: 345 microversion: 2.1 time: 0.061716 Apr 12 06:45:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 287/861] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:32 2023] GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:32 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d1460d84-2ff2-4996-af6e-c2f9941abb0f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Action: 'create', calling method: .version_select at 0x7fd24da6fb50>, body: {"snapshot": {"volume_id": "904a26e6-6130-4b34-a398-ae7999b06825", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1204814181"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d1460d84-2ff2-4996-af6e-c2f9941abb0f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.189670 Apr 12 06:45:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 288/862] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 06:45:32 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-59a00d20-09d3-42cc-b360-80db5dc9aac8 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbcc9d0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-59a00d20-09d3-42cc-b360-80db5dc9aac8 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 200 len: 287 microversion: 2.1 time: 0.032437 Apr 12 06:45:32 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 288/863] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 06:45:32 2023] GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-532411ed-18fd-4796-80c6-b6bfc5fed35b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24da8b760>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-532411ed-18fd-4796-80c6-b6bfc5fed35b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.045427 Apr 12 06:45:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 288/864] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 06:45:32 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c76772a6-677d-476e-b533-06721d1bed94 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbcfd00>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c76772a6-677d-476e-b533-06721d1bed94 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 200 len: 287 microversion: 2.1 time: 0.033425 Apr 12 06:45:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 289/865] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 06:45:32 2023] GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fe8da21c-5389-4d0b-a7e8-5926a85dba41 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbce3b0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fe8da21c-5389-4d0b-a7e8-5926a85dba41 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 200 len: 288 microversion: 2.1 time: 0.030725 Apr 12 06:45:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 289/866] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 06:45:33 2023] GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 288 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:33 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24db30700>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:33 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-b872e089-b0b3-4f33-9eaa-2f531b8fdccb tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 202 len: 0 microversion: 2.1 time: 0.060115 Apr 12 06:45:33 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 289/867] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 06:45:33 2023] DELETE /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:45:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-34b03c64-3a71-4a84-be8b-f00e27efaa7f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24db7bd00>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-34b03c64-3a71-4a84-be8b-f00e27efaa7f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 200 len: 287 microversion: 2.1 time: 0.033786 Apr 12 06:45:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 290/868] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 06:45:33 2023] GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:45:34 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 HTTP/1.1 Apr 12 06:45:34 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:45:34 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:45:34 user devstack@n-api.service[62040]: Connection: close Apr 12 06:45:34 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:45:34 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:45:34 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:45:34 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:45:34 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:45:34 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62040]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:45:34 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:45:34 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:45:34 user devstack@n-api.service[62040]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:45:34 user devstack@n-api.service[62040]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:45:34 user devstack@n-api.service[62040]: method: > Apr 12 06:45:34 user devstack@n-api.service[62040]: exception: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62040]: action_args: {'id': '51402ffe-ef35-41a3-811b-5a00788a13d8'} Apr 12 06:45:34 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b136f56b-9ac9-46f9-a6a6-d0d2d7fc9565 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 404 len: 111 microversion: 2.1 time: 0.027777 Apr 12 06:45:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 290/869] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:34 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:45:34 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 HTTP/1.1 Apr 12 06:45:34 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:34 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:34 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:34 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:34 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:34 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:34 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:34 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:45:34 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62042]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:45:34 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:34 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:34 user devstack@n-api.service[62042]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:45:34 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:45:34 user devstack@n-api.service[62042]: method: > Apr 12 06:45:34 user devstack@n-api.service[62042]: exception: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62042]: action_args: {'id': '51402ffe-ef35-41a3-811b-5a00788a13d8'} Apr 12 06:45:34 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1f1535f4-1ee9-4c38-bb79-e3f8ac2acab7 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 404 len: 111 microversion: 2.1 time: 0.029075 Apr 12 06:45:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 290/870] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:34 2023] DELETE /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:45:34 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 HTTP/1.1 Apr 12 06:45:34 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:34 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:34 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:34 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:34 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:34 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:34 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:34 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:45:34 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:45:34 user devstack@n-api.service[62041]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:45:34 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:34 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:34 user devstack@n-api.service[62041]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:45:34 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:45:34 user devstack@n-api.service[62041]: method: > Apr 12 06:45:34 user devstack@n-api.service[62041]: exception: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62041]: action_args: {'id': '51402ffe-ef35-41a3-811b-5a00788a13d8'} Apr 12 06:45:34 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. Apr 12 06:45:34 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8151fe37-9bb0-4e1c-86b9-eacfd4aa3e3e tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8" status: 404 len: 111 microversion: 2.1 time: 0.028600 Apr 12 06:45:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 291/871] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:34 2023] GET /compute/v2.1/servers/51402ffe-ef35-41a3-811b-5a00788a13d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:45:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86" status: 204 len: 0 microversion: 2.1 time: 0.133906 Apr 12 06:45:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 291/872] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:45:34 2023] DELETE /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-5c318f34-883a-4123-b94b-2c2b5a7e4673 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86" status: 200 len: 1545 microversion: 2.1 time: 0.207525 Apr 12 06:45:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 291/873] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:45:34 2023] GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 => generated 1545 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fcecca32-2da7-4316-a7ef-f194e3bcb859 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbcfb50>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "name": "network-vif-unplugged", "status": "completed", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fcecca32-2da7-4316-a7ef-f194e3bcb859 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 200 len: 287 microversion: 2.1 time: 0.042258 Apr 12 06:45:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 292/874] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 06:45:34 2023] GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Creating event network-vif-unplugged:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:45:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040833 Apr 12 06:45:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 292/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-23b7a014-c1a6-44ff-bb91-231072ec30a3 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24eaf2b00>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-23b7a014-c1a6-44ff-bb91-231072ec30a3 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] HTTP exception thrown: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. Apr 12 06:45:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-23b7a014-c1a6-44ff-bb91-231072ec30a3 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Request method failure captured: Apr 12 06:45:35 user devstack@n-api.service[62042]: request: GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 HTTP/1.1 Apr 12 06:45:35 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:35 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:35 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:35 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:35 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:35 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:35 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:35 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlOKx5QfxkPDOujFmOlGPHe79CUAdiyEJ4dIpoKOTHUu-kEbj8y-G17t-Fkbchnk4UI3fOMnqp5svYjcjMB8vc4slnFa7a1-NSDV54-KPBUdRMfyTTzYP3GOcfYFBT4xZSGjOGDj5Ka5DPwCVcjX-btFfkNqHMYD3rCQpGph-zNftCg Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Project-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6629b520a584784bbb32cf314421c23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}] Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Tenant-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-User: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:35 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:35 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:35 user devstack@n-api.service[62042]: X-User-Id: ced2c9f52fa34c9c84ff0f6b292b5720 Apr 12 06:45:35 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:35 user devstack@n-api.service[62042]: method: Apr 12 06:45:35 user devstack@n-api.service[62042]: exception: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. Apr 12 06:45:35 user devstack@n-api.service[62042]: action_args: {'id': 'a2bd7753-d7fd-4413-89c8-774b76bd0b73'} Apr 12 06:45:35 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. (HTTP 404) (Request-ID: req-5f0c4a06-ba25-45a6-9189-dbf6afc52e9f) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. Apr 12 06:45:35 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-23b7a014-c1a6-44ff-bb91-231072ec30a3 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Returning 404 to user: Snapshot a2bd7753-d7fd-4413-89c8-774b76bd0b73 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-23b7a014-c1a6-44ff-bb91-231072ec30a3 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73" status: 404 len: 111 microversion: 2.1 time: 0.031516 Apr 12 06:45:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 292/876] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 06:45:35 2023] GET /compute/v2.1/os-snapshots/a2bd7753-d7fd-4413-89c8-774b76bd0b73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7039e5c5-f80f-477d-ad2b-beff88330cbd tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dacc430>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7039e5c5-f80f-477d-ad2b-beff88330cbd tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 202 len: 0 microversion: 2.1 time: 0.063689 Apr 12 06:45:35 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 293/877] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:45:35 2023] DELETE /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:45:35 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-59c50c51-d1f9-49bc-b5e0-bcfdef28b5c1 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbce8c0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:35 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-59c50c51-d1f9-49bc-b5e0-bcfdef28b5c1 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 200 len: 344 microversion: 2.1 time: 0.067949 Apr 12 06:45:35 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 293/878] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:35 2023] GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "name": "network-vif-plugged", "status": "completed", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}, {"server_uuid": "659489bb-3672-4f70-9ab5-b37f310a7d86", "name": "network-vif-deleted", "tag": "744814ae-b032-41e5-b122-8d5ff605d349"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:36 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:36 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=31 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Creating event network-vif-plugged:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:45:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Creating event network-vif-deleted:744814ae-b032-41e5-b122-8d5ff605d349 for instance 659489bb-3672-4f70-9ab5-b37f310a7d86 on user Apr 12 06:45:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040636 Apr 12 06:45:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 293/879] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:36 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d7849144-183e-4472-ae8a-b3daf8131441 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dca2290>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d7849144-183e-4472-ae8a-b3daf8131441 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 200 len: 344 microversion: 2.1 time: 0.054424 Apr 12 06:45:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 294/880] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:36 2023] GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:37 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-bf69bb71-033b-4ba4-9327-28a139df5ea9 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dbabac0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-bf69bb71-033b-4ba4-9327-28a139df5ea9 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] HTTP exception thrown: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-bf69bb71-033b-4ba4-9327-28a139df5ea9 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Request method failure captured: Apr 12 06:45:38 user devstack@n-api.service[62040]: request: GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 HTTP/1.1 Apr 12 06:45:38 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:45:38 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:45:38 user devstack@n-api.service[62040]: Connection: close Apr 12 06:45:38 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:45:38 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:45:38 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:45:38 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:45:38 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlOKx5QfxkPDOujFmOlGPHe79CUAdiyEJ4dIpoKOTHUu-kEbj8y-G17t-Fkbchnk4UI3fOMnqp5svYjcjMB8vc4slnFa7a1-NSDV54-KPBUdRMfyTTzYP3GOcfYFBT4xZSGjOGDj5Ka5DPwCVcjX-btFfkNqHMYD3rCQpGph-zNftCg Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Project-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6629b520a584784bbb32cf314421c23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}] Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Tenant-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-User: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:38 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:45:38 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:45:38 user devstack@n-api.service[62040]: X-User-Id: ced2c9f52fa34c9c84ff0f6b292b5720 Apr 12 06:45:38 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:38 user devstack@n-api.service[62040]: method: Apr 12 06:45:38 user devstack@n-api.service[62040]: exception: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62040]: action_args: {'id': '904a26e6-6130-4b34-a398-ae7999b06825'} Apr 12 06:45:38 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. (HTTP 404) (Request-ID: req-393d5e94-2cdb-471b-96d2-0d89114f0f0a) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-bf69bb71-033b-4ba4-9327-28a139df5ea9 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Returning 404 to user: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-bf69bb71-033b-4ba4-9327-28a139df5ea9 tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 404 len: 109 microversion: 2.1 time: 0.042205 Apr 12 06:45:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 294/881] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:37 2023] GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a68fac5a-f92d-4d36-be67-7341c37f205b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24def1750>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-a68fac5a-f92d-4d36-be67-7341c37f205b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] HTTP exception thrown: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a68fac5a-f92d-4d36-be67-7341c37f205b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Request method failure captured: Apr 12 06:45:38 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 HTTP/1.1 Apr 12 06:45:38 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:38 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:38 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:38 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:38 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:38 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:38 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:38 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlOKx5QfxkPDOujFmOlGPHe79CUAdiyEJ4dIpoKOTHUu-kEbj8y-G17t-Fkbchnk4UI3fOMnqp5svYjcjMB8vc4slnFa7a1-NSDV54-KPBUdRMfyTTzYP3GOcfYFBT4xZSGjOGDj5Ka5DPwCVcjX-btFfkNqHMYD3rCQpGph-zNftCg Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Project-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6629b520a584784bbb32cf314421c23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}] Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Tenant-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-User: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:38 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:38 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:38 user devstack@n-api.service[62042]: X-User-Id: ced2c9f52fa34c9c84ff0f6b292b5720 Apr 12 06:45:38 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:38 user devstack@n-api.service[62042]: method: Apr 12 06:45:38 user devstack@n-api.service[62042]: exception: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62042]: action_args: {'id': '904a26e6-6130-4b34-a398-ae7999b06825'} Apr 12 06:45:38 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. (HTTP 404) (Request-ID: req-bf31842c-e442-4c03-839e-2cb9f7fd5585) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a68fac5a-f92d-4d36-be67-7341c37f205b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Returning 404 to user: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a68fac5a-f92d-4d36-be67-7341c37f205b tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 404 len: 109 microversion: 2.1 time: 0.034358 Apr 12 06:45:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 294/882] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:45:38 2023] DELETE /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a20888a4-90b4-4e3a-bbb2-6a09c4e62d1f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Calling method '.version_select at 0x7fd24dacc8b0>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-a20888a4-90b4-4e3a-bbb2-6a09c4e62d1f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] HTTP exception thrown: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a20888a4-90b4-4e3a-bbb2-6a09c4e62d1f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Request method failure captured: Apr 12 06:45:38 user devstack@n-api.service[62041]: request: GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 HTTP/1.1 Apr 12 06:45:38 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:38 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:38 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:38 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:38 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:38 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:38 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:38 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlOKx5QfxkPDOujFmOlGPHe79CUAdiyEJ4dIpoKOTHUu-kEbj8y-G17t-Fkbchnk4UI3fOMnqp5svYjcjMB8vc4slnFa7a1-NSDV54-KPBUdRMfyTTzYP3GOcfYFBT4xZSGjOGDj5Ka5DPwCVcjX-btFfkNqHMYD3rCQpGph-zNftCg Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Project-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6629b520a584784bbb32cf314421c23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6629b520a584784bbb32cf314421c23"}]}] Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Tenant-Id: e6629b520a584784bbb32cf314421c23 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1148876356 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-User: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:38 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:38 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:38 user devstack@n-api.service[62041]: X-User-Id: ced2c9f52fa34c9c84ff0f6b292b5720 Apr 12 06:45:38 user devstack@n-api.service[62041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1148876356-project-member Apr 12 06:45:38 user devstack@n-api.service[62041]: method: Apr 12 06:45:38 user devstack@n-api.service[62041]: exception: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62041]: action_args: {'id': '904a26e6-6130-4b34-a398-ae7999b06825'} Apr 12 06:45:38 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. (HTTP 404) (Request-ID: req-d06f9eee-ebb7-46a7-bef9-85f3d31ece45) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. Apr 12 06:45:38 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a20888a4-90b4-4e3a-bbb2-6a09c4e62d1f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] Returning 404 to user: Volume 904a26e6-6130-4b34-a398-ae7999b06825 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a20888a4-90b4-4e3a-bbb2-6a09c4e62d1f tempest-VolumesSnapshotsTestJSON-1148876356 tempest-VolumesSnapshotsTestJSON-1148876356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825" status: 404 len: 109 microversion: 2.1 time: 0.035051 Apr 12 06:45:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 295/883] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:38 2023] GET /compute/v2.1/os-volumes/904a26e6-6130-4b34-a398-ae7999b06825 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3d5676df-98bc-43ac-bb23-ed651918cba7 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Action: 'create', calling method: .version_select at 0x7fd24dbcf1c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-852433196", "metadata": {"Type": "work"}}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3d5676df-98bc-43ac-bb23-ed651918cba7 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.444242 Apr 12 06:45:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 295/884] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 06:45:39 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 446 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 06:45:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d7e3067d-f492-4de3-8eb9-caad309d30be tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24eaf1000>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d7e3067d-f492-4de3-8eb9-caad309d30be tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 200 len: 352 microversion: 2.1 time: 0.108830 Apr 12 06:45:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 295/885] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:40 2023] GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:41 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-30867a49-1281-4e55-b712-a1968f2f47c2 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24dbcfac0>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-30867a49-1281-4e55-b712-a1968f2f47c2 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 200 len: 353 microversion: 2.1 time: 0.075029 Apr 12 06:45:41 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 296/886] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:41 2023] GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a6507d5e-3fc1-4fe3-8b33-f3ead868d240 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24dbcdfc0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a6507d5e-3fc1-4fe3-8b33-f3ead868d240 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 200 len: 353 microversion: 2.1 time: 0.049825 Apr 12 06:45:41 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 296/887] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:41 2023] GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-5b46cde7-390f-4ad4-bfb5-74706aa7576f tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24e0ead40>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-5b46cde7-390f-4ad4-bfb5-74706aa7576f tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 202 len: 0 microversion: 2.1 time: 0.084341 Apr 12 06:45:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 296/888] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 06:45:41 2023] DELETE /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:45:41 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8d59f761-ac8c-43e2-a425-dca45b0e447f tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24daccf70>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8d59f761-ac8c-43e2-a425-dca45b0e447f tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 200 len: 352 microversion: 2.1 time: 0.052060 Apr 12 06:45:41 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 297/889] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:41 2023] GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-623e8e9f-fbab-420c-b4ff-de8036049691 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24dbcdc60>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-623e8e9f-fbab-420c-b4ff-de8036049691 tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 200 len: 352 microversion: 2.1 time: 0.047940 Apr 12 06:45:42 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 297/890] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:42 2023] GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9d0b606f-d223-4fe1-bc40-7631a62a8dff tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Calling method '.version_select at 0x7fd24e1a79a0>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-9d0b606f-d223-4fe1-bc40-7631a62a8dff tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] HTTP exception thrown: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. Apr 12 06:45:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9d0b606f-d223-4fe1-bc40-7631a62a8dff tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Request method failure captured: Apr 12 06:45:43 user devstack@n-api.service[62042]: request: GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c HTTP/1.1 Apr 12 06:45:43 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:45:43 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:45:43 user devstack@n-api.service[62042]: Connection: close Apr 12 06:45:43 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:45:43 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:45:43 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:45:43 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:45:43 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlOTfSXENQlvVqOlma_fyhJsV7Wy7AZ1wh6dqrhHG5FgZzxDMG3oZM489RTijIDX0IoIrtud9rpkBtJFgf6ZSdZa9MS9UZ1-w3jfstq6LwfOXW2iKAZT5bPxciI7C7-lRXoHKVe6aWorVteyupJwVxttpWGxwQkoNx7jVrdUnCkre6U Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Project-Id: 1c8e84dc2c0947e2a9f89b466ba70252 Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Project-Name: tempest-VolumesGetTestJSON-921747519 Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c8e84dc2c0947e2a9f89b466ba70252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c8e84dc2c0947e2a9f89b466ba70252"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c8e84dc2c0947e2a9f89b466ba70252"}]}] Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Tenant: tempest-VolumesGetTestJSON-921747519 Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Tenant-Id: 1c8e84dc2c0947e2a9f89b466ba70252 Apr 12 06:45:43 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-VolumesGetTestJSON-921747519 Apr 12 06:45:43 user devstack@n-api.service[62042]: X-User: tempest-VolumesGetTestJSON-921747519-project-member Apr 12 06:45:43 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:45:43 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:45:43 user devstack@n-api.service[62042]: X-User-Id: c8b97595d92645c8a4f417da05a48a7f Apr 12 06:45:43 user devstack@n-api.service[62042]: X-User-Name: tempest-VolumesGetTestJSON-921747519-project-member Apr 12 06:45:43 user devstack@n-api.service[62042]: method: Apr 12 06:45:43 user devstack@n-api.service[62042]: exception: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. Apr 12 06:45:43 user devstack@n-api.service[62042]: action_args: {'id': '02e84623-2f01-4559-bc01-d9055ae08d5c'} Apr 12 06:45:43 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. (HTTP 404) (Request-ID: req-e9eef316-1ce4-4ce7-9885-d41c62a785af) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. Apr 12 06:45:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:45:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-9d0b606f-d223-4fe1-bc40-7631a62a8dff tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] Returning 404 to user: Volume 02e84623-2f01-4559-bc01-d9055ae08d5c could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-9d0b606f-d223-4fe1-bc40-7631a62a8dff tempest-VolumesGetTestJSON-921747519 tempest-VolumesGetTestJSON-921747519-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c" status: 404 len: 109 microversion: 2.1 time: 0.042831 Apr 12 06:45:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 297/891] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:45:43 2023] GET /compute/v2.1/os-volumes/02e84623-2f01-4559-bc01-d9055ae08d5c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HTTP exception thrown: Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c could not be found. Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Request method failure captured: Apr 12 06:45:56 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c HTTP/1.1 Apr 12 06:45:56 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:45:56 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:45:56 user devstack@n-api.service[62041]: Connection: close Apr 12 06:45:56 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:45:56 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:45:56 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:45:56 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:45:56 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk8NZh5cpkCX1ZoLZ8wZDH31-YYdV15CsqxZXJ_6qHwgba9fAmfhcLqkRe_sf1KH3FVDMOTMX9K3u1KD2bt_8XboipxsPkm3n2wiFW0-EI2iq1jwMZD26fnIv-XzdUMTH7l1ipiT-h83r7-Wlvi1-0bNPix8_k5mivwSPVbnjLNQicg Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Project-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}] Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Tenant-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:45:56 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:45:56 user devstack@n-api.service[62041]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:45:56 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:45:56 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:45:56 user devstack@n-api.service[62041]: X-User-Id: 2e5e4455358643b8830ce8c96aad5aad Apr 12 06:45:56 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:45:56 user devstack@n-api.service[62041]: method: > Apr 12 06:45:56 user devstack@n-api.service[62041]: exception: Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c could not be found. Apr 12 06:45:56 user devstack@n-api.service[62041]: action_args: {'id': 'ebb36f74-c4a3-4108-949d-1fb8918f9a8c'} Apr 12 06:45:56 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c could not be found. Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c could not be found. Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c could not be found. Apr 12 06:45:56 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Returning 404 to user: Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:45:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b22605bf-ea6e-471c-9139-ba0d0d14b691 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c" status: 404 len: 111 microversion: 2.87 time: 0.035700 Apr 12 06:45:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 298/892] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:45:56 2023] GET /compute/v2.1/servers/ebb36f74-c4a3-4108-949d-1fb8918f9a8c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:45:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f" status: 204 len: 0 microversion: 2.87 time: 0.124315 Apr 12 06:45:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 298/893] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:45:56 2023] DELETE /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:56 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:45:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-fb8150d5-60fd-4b8f-aa52-b95a23048dba tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f" status: 200 len: 1696 microversion: 2.87 time: 0.215153 Apr 12 06:45:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 298/894] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:45:56 2023] GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6c87b7-75d7-429e-9f7b-e8a959f1791f", "name": "network-vif-unplugged", "status": "completed", "tag": "c9e9de0e-798c-49fb-aeb3-30eccc267206"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Creating event network-vif-unplugged:c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f on user Apr 12 06:45:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039096 Apr 12 06:45:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 299/895] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:57 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6c87b7-75d7-429e-9f7b-e8a959f1791f", "name": "network-vif-deleted", "tag": "c9e9de0e-798c-49fb-aeb3-30eccc267206"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:57 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] Creating event network-vif-deleted:c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f on user Apr 12 06:45:57 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034755 Apr 12 06:45:57 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 299/896] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:45:58 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6c87b7-75d7-429e-9f7b-e8a959f1791f", "name": "network-vif-plugged", "status": "completed", "tag": "c9e9de0e-798c-49fb-aeb3-30eccc267206"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:45:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:45:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:45:58 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:45:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Creating event network-vif-plugged:c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f on user Apr 12 06:45:58 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029063 Apr 12 06:45:58 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 299/897] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] HTTP exception thrown: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 could not be found. Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Request method failure captured: Apr 12 06:46:03 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 HTTP/1.1 Apr 12 06:46:03 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:46:03 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:46:03 user devstack@n-api.service[62041]: Connection: close Apr 12 06:46:03 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:46:03 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:46:03 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:46:03 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:46:03 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk-JeNy21s7Rknzj_nYv8cM8VvntK8qM6XljS0AYLMp6b6peVEx3_8-7Fdr60hQbsU-v6H8YO8JJkx117AZ6zzEi9eNJl_J-BtRjuUxbU3T67SujETdbUCYBSn16znapXlFxKFgQZopvXzgp3fxTKXFhZD7CaHJqa3SLnDmhazrsekM Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Project-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972842dc32ee4687866dfe2fbefe9cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972842dc32ee4687866dfe2fbefe9cb4"}]}] Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Tenant-Id: 972842dc32ee4687866dfe2fbefe9cb4 Apr 12 06:46:03 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1179647693 Apr 12 06:46:03 user devstack@n-api.service[62041]: X-User: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:46:03 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:46:03 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:46:03 user devstack@n-api.service[62041]: X-User-Id: dc8e6af1db834409a4880040a5ef6a5a Apr 12 06:46:03 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1179647693-project-member Apr 12 06:46:03 user devstack@n-api.service[62041]: method: > Apr 12 06:46:03 user devstack@n-api.service[62041]: exception: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 could not be found. Apr 12 06:46:03 user devstack@n-api.service[62041]: action_args: {'id': '5364688b-cc08-4407-94f5-974846ae7bb8'} Apr 12 06:46:03 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 could not be found. Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 could not be found. Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 could not be found. Apr 12 06:46:03 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:03 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Returning 404 to user: Instance 5364688b-cc08-4407-94f5-974846ae7bb8 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:46:03 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8c5dd609-602b-4294-b6fd-bf2db7bc5685 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8" status: 404 len: 111 microversion: 2.1 time: 0.027626 Apr 12 06:46:03 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 300/898] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:46:03 2023] GET /compute/v2.1/servers/5364688b-cc08-4407-94f5-974846ae7bb8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:11 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:46:11 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4f2cf4ba-fd12-4edd-91c2-dc5b3ac347de tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e" status: 200 len: 1495 microversion: 2.1 time: 0.195131 Apr 12 06:46:11 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 300/899] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:46:11 2023] GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e => generated 1495 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1603035936", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] validate_networks() for None {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Getting quotas for project 5098984b6bda4c2d9a71023292e7815c. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Getting quotas for user c93cca7970df482f8c3a00f15ef12fde and project 5098984b6bda4c2d9a71023292e7815c. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:46:19 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:46:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.412955 Apr 12 06:46:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 300/900] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:46:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:46:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-817d6ab8-90de-45a2-a9fe-61dd8dc62027 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-817d6ab8-90de-45a2-a9fe-61dd8dc62027 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:19 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-817d6ab8-90de-45a2-a9fe-61dd8dc62027 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93cca7970df482f8c3a00f15ef12fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5098984b6bda4c2d9a71023292e7815c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:46:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-817d6ab8-90de-45a2-a9fe-61dd8dc62027 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853" status: 200 len: 1209 microversion: 2.1 time: 0.071007 Apr 12 06:46:19 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 301/901] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:46:19 2023] GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853 => generated 1209 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:46:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4783e1-34e3-425c-87c3-ee8bda2c6853", "tag": "ad8cf137-9750-4de8-8c9e-1fca491a3348"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:21 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:21 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Creating event network-changed:ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 on user Apr 12 06:46:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Apr 12 06:46:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 301/902] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4783e1-34e3-425c-87c3-ee8bda2c6853", "name": "network-vif-plugged", "status": "completed", "tag": "ad8cf137-9750-4de8-8c9e-1fca491a3348"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Creating event network-vif-plugged:ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 on user Apr 12 06:46:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044174 Apr 12 06:46:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 301/903] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 could not be found. Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:46:24 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 HTTP/1.1 Apr 12 06:46:24 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:46:24 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:46:24 user devstack@n-api.service[62041]: Connection: close Apr 12 06:46:24 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:46:24 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:46:24 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:46:24 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:46:24 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:46:24 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:24 user devstack@n-api.service[62041]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:46:24 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:46:24 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:46:24 user devstack@n-api.service[62041]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:46:24 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:46:24 user devstack@n-api.service[62041]: method: > Apr 12 06:46:24 user devstack@n-api.service[62041]: exception: Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 could not be found. Apr 12 06:46:24 user devstack@n-api.service[62041]: action_args: {'id': '659489bb-3672-4f70-9ab5-b37f310a7d86'} Apr 12 06:46:24 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 could not be found. Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 could not be found. Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 could not be found. Apr 12 06:46:24 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:24 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:46:24 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-783a0915-dbc4-4ff5-bf42-cda0ca451fe8 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86" status: 404 len: 111 microversion: 2.1 time: 0.040982 Apr 12 06:46:24 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 302/904] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:46:24 2023] GET /compute/v2.1/servers/659489bb-3672-4f70-9ab5-b37f310a7d86 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:46:25 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4783e1-34e3-425c-87c3-ee8bda2c6853", "name": "network-vif-plugged", "status": "completed", "tag": "ad8cf137-9750-4de8-8c9e-1fca491a3348"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Creating event network-vif-plugged:ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 on user Apr 12 06:46:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081117 Apr 12 06:46:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 302/905] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:46:29 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 HTTP/1.1 Apr 12 06:46:29 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:46:29 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:46:29 user devstack@n-api.service[62042]: Connection: close Apr 12 06:46:29 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:46:29 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:46:29 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:46:29 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:46:29 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:46:29 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:29 user devstack@n-api.service[62042]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:46:29 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:46:29 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:46:29 user devstack@n-api.service[62042]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:46:29 user devstack@n-api.service[62042]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:46:29 user devstack@n-api.service[62042]: method: > Apr 12 06:46:29 user devstack@n-api.service[62042]: exception: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62042]: action_args: {'id': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'} Apr 12 06:46:29 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:46:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8cd9e710-3e1f-4109-b770-1d0c27a9c7cd tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 404 len: 111 microversion: 2.1 time: 0.031566 Apr 12 06:46:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 302/906] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:46:29 2023] DELETE /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HTTP exception thrown: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Request method failure captured: Apr 12 06:46:29 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 HTTP/1.1 Apr 12 06:46:29 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:46:29 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:46:29 user devstack@n-api.service[62041]: Connection: close Apr 12 06:46:29 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:46:29 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:46:29 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:46:29 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:46:29 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk33Z-p2UWaAiMXPXtQ1yMnmkt_EiAhJZTKYrv7PKYa6GPSuZdXZl_KAw2jCzB1dgaYhgPiUpqynNWrqdhEXGcOqgrbHAZfGIHv1JQqT00PsbgSz41690So8tezUlzujB3vvjI0kX1U8WHTteONKmDnPbYYCVyA1iNDO1BlVFzwRlJk Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Project-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/54fd87c4105246c1ac1bdf424c83b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/54fd87c4105246c1ac1bdf424c83b7aa"}]}] Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Tenant-Id: 54fd87c4105246c1ac1bdf424c83b7aa Apr 12 06:46:29 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerActionsTestJSON-752347644 Apr 12 06:46:29 user devstack@n-api.service[62041]: X-User: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:46:29 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:46:29 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:46:29 user devstack@n-api.service[62041]: X-User-Id: ad316acdc89947bbba60c75e9a24d7e9 Apr 12 06:46:29 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerActionsTestJSON-752347644-project-member Apr 12 06:46:29 user devstack@n-api.service[62041]: method: > Apr 12 06:46:29 user devstack@n-api.service[62041]: exception: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62041]: action_args: {'id': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'} Apr 12 06:46:29 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. Apr 12 06:46:29 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Returning 404 to user: Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:46:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1c552da0-c29e-4cd1-af72-f6bbc428c7ea tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624" status: 404 len: 111 microversion: 2.1 time: 0.040802 Apr 12 06:46:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 303/907] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:46:29 2023] GET /compute/v2.1/servers/5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 06:46:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3b6f9bb2-462e-4082-940a-1a9e38903d32 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Calling method '.version_select at 0x7fd24dbaa290>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3b6f9bb2-462e-4082-940a-1a9e38903d32 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698395184" status: 202 len: 0 microversion: 2.1 time: 0.039765 Apr 12 06:46:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 303/908] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 06:46:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698395184 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2d93960d-7cfa-4c2a-bb38-3850689808f0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'create', calling method: .version_select at 0x7fd24def1900>, body: {"keypair": {"name": "tempest-keypair-914952928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZegZIYK1I87WzI/GopP0gFDiVIk2m3tD+Xr8CMKYFLScduowkDoSCdMQjYZBkxgp/FVmCcjJUpm9/3fq/7gj6jh4/k43FpV6VBh16G/3bTDxKZLcvBw9dpNKFRqAyABQ=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-2d93960d-7cfa-4c2a-bb38-3850689808f0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:46:40 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-2d93960d-7cfa-4c2a-bb38-3850689808f0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for user 4fbb8c37e5a74a0b83011c2a21033204 and project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:46:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-2d93960d-7cfa-4c2a-bb38-3850689808f0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.181101 Apr 12 06:46:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 303/909] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 06:46:40 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2020171009", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f1744f20-6d53-4995-b638-1b500b3a999a"}], "security_groups": [{"name": "tempest-securitygroup--1917168182"}], "key_name": "tempest-keypair-914952928", "user_data": "}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] validate_networks() for [('f1744f20-6d53-4995-b638-1b500b3a999a', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for user 4fbb8c37e5a74a0b83011c2a21033204 and project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:46:42 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:46:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.781669 Apr 12 06:46:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 304/910] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:46:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:46:42 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:42 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-e14958b6-c34d-4fef-9b7b-aaa2f707109c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:42 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-e14958b6-c34d-4fef-9b7b-aaa2f707109c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e14958b6-c34d-4fef-9b7b-aaa2f707109c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:46:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e14958b6-c34d-4fef-9b7b-aaa2f707109c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:46:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-e14958b6-c34d-4fef-9b7b-aaa2f707109c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:46:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-e14958b6-c34d-4fef-9b7b-aaa2f707109c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1275 microversion: 2.20 time: 0.078259 Apr 12 06:46:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 304/911] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:46:42 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1275 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:46:45 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:45 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Creating event network-changed:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:46:45 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028286 Apr 12 06:46:45 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 304/912] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:46:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HTTP exception thrown: Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f could not be found. Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Request method failure captured: Apr 12 06:46:46 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f HTTP/1.1 Apr 12 06:46:46 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:46:46 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:46:46 user devstack@n-api.service[62041]: Connection: close Apr 12 06:46:46 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:46:46 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:46:46 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:46:46 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:46:46 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNk8NZh5cpkCX1ZoLZ8wZDH31-YYdV15CsqxZXJ_6qHwgba9fAmfhcLqkRe_sf1KH3FVDMOTMX9K3u1KD2bt_8XboipxsPkm3n2wiFW0-EI2iq1jwMZD26fnIv-XzdUMTH7l1ipiT-h83r7-Wlvi1-0bNPix8_k5mivwSPVbnjLNQicg Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Project-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ecae91e53ee4d70a8dc24c7febc2a0e"}]}] Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Tenant-Id: 0ecae91e53ee4d70a8dc24c7febc2a0e Apr 12 06:46:46 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056 Apr 12 06:46:46 user devstack@n-api.service[62041]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:46:46 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:46:46 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:46:46 user devstack@n-api.service[62041]: X-User-Id: 2e5e4455358643b8830ce8c96aad5aad Apr 12 06:46:46 user devstack@n-api.service[62041]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member Apr 12 06:46:46 user devstack@n-api.service[62041]: method: > Apr 12 06:46:46 user devstack@n-api.service[62041]: exception: Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f could not be found. Apr 12 06:46:46 user devstack@n-api.service[62041]: action_args: {'id': '0a6c87b7-75d7-429e-9f7b-e8a959f1791f'} Apr 12 06:46:46 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f could not be found. Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f could not be found. Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f could not be found. Apr 12 06:46:46 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:46:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Returning 404 to user: Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:46:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4b68c426-9967-4d16-9545-7e880212f924 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f" status: 404 len: 111 microversion: 2.87 time: 0.030448 Apr 12 06:46:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 305/913] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:46:46 2023] GET /compute/v2.1/servers/0a6c87b7-75d7-429e-9f7b-e8a959f1791f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:46:47 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:47 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:47 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:47 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:47 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:46:47 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045009 Apr 12 06:46:47 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 305/914] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:46:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:49 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:46:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:46:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:46:49 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:46:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:46:49 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028130 Apr 12 06:46:49 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 305/915] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:52 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fb218add-fc3c-4bbf-bd24-8f861915ae91 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dca31c0>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:52 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:52 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fb218add-fc3c-4bbf-bd24-8f861915ae91 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/82f2eeb4-dc21-4cef-b208-ca62e4284bc9" status: 200 len: 351 microversion: 2.1 time: 0.055836 Apr 12 06:46:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 306/916] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:46:52 2023] GET /compute/v2.1/os-volumes/82f2eeb4-dc21-4cef-b208-ca62e4284bc9 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:54 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-467fbbd7-9474-47ce-849f-ede03398f931 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dbcc8b0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-467fbbd7-9474-47ce-849f-ede03398f931 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555" status: 200 len: 351 microversion: 2.1 time: 0.064708 Apr 12 06:46:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 306/917] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:46:54 2023] GET /compute/v2.1/os-volumes/f1a6e6d2-28b6-44d5-a5c9-fabcf4ddd555 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:55 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:46:55 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-7e132029-f80c-4378-9487-ae98cdac08f4 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24da89480>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:55 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-7e132029-f80c-4378-9487-ae98cdac08f4 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/83bcd90e-163c-401e-8582-c288f038ea64" status: 200 len: 351 microversion: 2.1 time: 0.053106 Apr 12 06:46:55 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 306/918] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 06:46:55 2023] GET /compute/v2.1/os-volumes/83bcd90e-163c-401e-8582-c288f038ea64 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9689757c-4130-467d-9f7b-cd9daed8f572 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dbcc430>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9689757c-4130-467d-9f7b-cd9daed8f572 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082459 Apr 12 06:46:55 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 307/919] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 06:46:55 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:46:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-cbbc6bf2-6d1f-4405-a45f-504eaef014ae tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dbcf0a0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-cbbc6bf2-6d1f-4405-a45f-504eaef014ae tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089315 Apr 12 06:46:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 307/920] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 06:46:55 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-265138d5-1516-4676-8581-061f569ca694 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24da8b9a0>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-265138d5-1516-4676-8581-061f569ca694 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088879 Apr 12 06:46:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 307/921] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 06:46:56 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:46:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-34de8c98-cc7a-4c0c-babd-512db7a61234 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dd83760>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-34de8c98-cc7a-4c0c-babd-512db7a61234 tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083562 Apr 12 06:46:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 308/922] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 06:46:56 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-9eea172b-4f0b-455b-9e0f-8019f908c33a tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dbce440>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-9eea172b-4f0b-455b-9e0f-8019f908c33a tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.077923 Apr 12 06:46:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 308/923] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 06:46:56 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-56380d0d-2c6c-4efb-aae2-ac4b938311ac tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24db33370>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-56380d0d-2c6c-4efb-aae2-ac4b938311ac tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.079964 Apr 12 06:46:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 308/924] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 06:46:56 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:46:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-773d7776-778e-4e87-982d-af7f5703198f tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dbcfb50>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-773d7776-778e-4e87-982d-af7f5703198f tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081462 Apr 12 06:46:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 309/925] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 06:46:56 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:46:56 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-53de26e3-64cd-4a27-a5e1-043637ffaacf tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] Calling method '.version_select at 0x7fd24dbcfbe0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:46:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-53de26e3-64cd-4a27-a5e1-043637ffaacf tempest-VolumesTestJSON-1073101300 tempest-VolumesTestJSON-1073101300-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083404 Apr 12 06:46:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 309/926] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 06:46:56 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:09 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93cca7970df482f8c3a00f15ef12fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5098984b6bda4c2d9a71023292e7815c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:47:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-42720f50-c0f9-4f47-ad01-ba2ce062bc66 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853" status: 200 len: 1455 microversion: 2.1 time: 0.179984 Apr 12 06:47:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 309/927] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:47:09 2023] GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853 => generated 1455 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a3b8849-fc77-4b4a-858e-5eb6bd4612d0", "device": "/dev/vdb"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:11 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "POST /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483952 Apr 12 06:47:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 310/928] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:47:11 2023] POST /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:28 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'services' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:47:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e/os-volume_attachments/1a3b8849-fc77-4b4a-858e-5eb6bd4612d0" status: 202 len: 0 microversion: 2.1 time: 0.376503 Apr 12 06:47:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 310/929] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:47:28 2023] DELETE /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e/os-volume_attachments/1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:47:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e" status: 204 len: 0 microversion: 2.1 time: 0.164304 Apr 12 06:47:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 310/930] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:47:29 2023] DELETE /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:29 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:47:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-489a5820-26ed-4bea-a321-715ffefb652e tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e" status: 200 len: 1547 microversion: 2.1 time: 0.232606 Apr 12 06:47:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 311/931] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:47:29 2023] GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e => generated 1547 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:47:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f055ae-909d-4fda-a2d5-0f4aef77928e", "name": "network-vif-unplugged", "status": "completed", "tag": "2923dc36-c11b-43e4-afed-fb46cc033110"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:31 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Creating event network-vif-unplugged:2923dc36-c11b-43e4-afed-fb46cc033110 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e on user Apr 12 06:47:31 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040862 Apr 12 06:47:31 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 311/932] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f055ae-909d-4fda-a2d5-0f4aef77928e", "name": "network-vif-deleted", "tag": "2923dc36-c11b-43e4-afed-fb46cc033110"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] Creating event network-vif-deleted:2923dc36-c11b-43e4-afed-fb46cc033110 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e on user Apr 12 06:47:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029303 Apr 12 06:47:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 311/933] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f055ae-909d-4fda-a2d5-0f4aef77928e", "name": "network-vif-plugged", "status": "completed", "tag": "2923dc36-c11b-43e4-afed-fb46cc033110"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Creating event network-vif-plugged:2923dc36-c11b-43e4-afed-fb46cc033110 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e on user Apr 12 06:47:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030181 Apr 12 06:47:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 312/934] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:47:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:47:33 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:47:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3fb19026-1a88-4c61-bd98-ccefb323a250 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1587 microversion: 2.20 time: 0.172021 Apr 12 06:47:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 312/935] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:47:33 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1587 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:47:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8c631f5c-4f30-4781-b39a-e4dd5fece649 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'create', calling method: .version_select at 0x7fd24da89630>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1175210425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:38 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-8c631f5c-4f30-4781-b39a-e4dd5fece649 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:47:38 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-8c631f5c-4f30-4781-b39a-e4dd5fece649 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for user 2a188723ace3460792ed32d13bfe0d93 and project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:47:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8c631f5c-4f30-4781-b39a-e4dd5fece649 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043101 Apr 12 06:47:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 312/936] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:47:38 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1404205967", "imageRef": "bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1175210425", "networks": [{"uuid": "e15834f3-3252-4493-9d01-4c068834b98e"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:38 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] validate_networks() for [('e15834f3-3252-4493-9d01-4c068834b98e', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for user 2a188723ace3460792ed32d13bfe0d93 and project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:47:39 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:47:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.471947 Apr 12 06:47:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 313/937] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:47:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:47:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-6d8d1b22-2f8b-4c8b-892b-8ba694ae7fd2 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:47:39 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-6d8d1b22-2f8b-4c8b-892b-8ba694ae7fd2 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:47:39 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-6d8d1b22-2f8b-4c8b-892b-8ba694ae7fd2 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:47:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-6d8d1b22-2f8b-4c8b-892b-8ba694ae7fd2 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1253 microversion: 2.1 time: 0.067353 Apr 12 06:47:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 313/938] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:47:39 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1253 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:47:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Creating event network-changed:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:47:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044568 Apr 12 06:47:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 313/939] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:47:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-plugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Creating event network-vif-plugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:47:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038488 Apr 12 06:47:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 314/940] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:47:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:47:45 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-plugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:47:45 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:47:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:47:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:47:45 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:47:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Creating event network-vif-plugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:47:45 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038442 Apr 12 06:47:45 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 314/941] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:48:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853" status: 204 len: 0 microversion: 2.1 time: 0.125828 Apr 12 06:48:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 314/942] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:48:09 2023] DELETE /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:48:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:09 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:09 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:09 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:10 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93cca7970df482f8c3a00f15ef12fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5098984b6bda4c2d9a71023292e7815c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:48:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7a88c277-d6c9-4a03-83af-9dac6e880d70 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853" status: 200 len: 1461 microversion: 2.1 time: 0.245991 Apr 12 06:48:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 315/943] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:48:09 2023] GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853 => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4783e1-34e3-425c-87c3-ee8bda2c6853", "name": "network-vif-unplugged", "status": "completed", "tag": "ad8cf137-9750-4de8-8c9e-1fca491a3348"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Creating event network-vif-unplugged:ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 on user Apr 12 06:48:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037448 Apr 12 06:48:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 315/944] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:11 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4783e1-34e3-425c-87c3-ee8bda2c6853", "name": "network-vif-deleted", "tag": "ad8cf137-9750-4de8-8c9e-1fca491a3348"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] Creating event network-vif-deleted:ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 on user Apr 12 06:48:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 Apr 12 06:48:11 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 315/945] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4783e1-34e3-425c-87c3-ee8bda2c6853", "name": "network-vif-plugged", "status": "completed", "tag": "ad8cf137-9750-4de8-8c9e-1fca491a3348"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Creating event network-vif-plugged:ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 on user Apr 12 06:48:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028492 Apr 12 06:48:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 316/946] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] HTTP exception thrown: Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e could not be found. Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Request method failure captured: Apr 12 06:48:19 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e HTTP/1.1 Apr 12 06:48:19 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:48:19 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:48:19 user devstack@n-api.service[62040]: Connection: close Apr 12 06:48:19 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:48:19 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:48:19 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:48:19 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:48:19 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlLAwk9WwI_YWGMBxxHqrkJ3qKlWZvJA29x-LEgjPdzb9oA61H1zKzi5x-BlmGTj0mB_0JxPsyu7CP8AAhp2jvLVlX7e02vIIbVFoIeUVnuD0w8XokaWPIQjkqYYdjheu13KXMt8Q634sr1EWmNX7CK-oXjVyu0hgrGsRHS9qaRDj-k Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Project-Id: af34529636fc4221921028f93b1c381a Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2015355536 Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34529636fc4221921028f93b1c381a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af34529636fc4221921028f93b1c381a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34529636fc4221921028f93b1c381a"}]}] Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesSnapshotTestJSON-2015355536 Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Tenant-Id: af34529636fc4221921028f93b1c381a Apr 12 06:48:19 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2015355536 Apr 12 06:48:19 user devstack@n-api.service[62040]: X-User: tempest-VolumesSnapshotTestJSON-2015355536-project-member Apr 12 06:48:19 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:48:19 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:48:19 user devstack@n-api.service[62040]: X-User-Id: 8546fd1ed08b4e88a945e73347be38c2 Apr 12 06:48:19 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesSnapshotTestJSON-2015355536-project-member Apr 12 06:48:19 user devstack@n-api.service[62040]: method: > Apr 12 06:48:19 user devstack@n-api.service[62040]: exception: Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e could not be found. Apr 12 06:48:19 user devstack@n-api.service[62040]: action_args: {'id': '20f055ae-909d-4fda-a2d5-0f4aef77928e'} Apr 12 06:48:19 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e could not be found. Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e could not be found. Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e could not be found. Apr 12 06:48:19 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:48:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Returning 404 to user: Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:48:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ec6c94fa-a1f1-47cc-b76a-4007a6791355 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e" status: 404 len: 111 microversion: 2.1 time: 0.036462 Apr 12 06:48:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 316/947] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:48:19 2023] GET /compute/v2.1/servers/20f055ae-909d-4fda-a2d5-0f4aef77928e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:29 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:48:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e9052af3-4dbb-4ea7-86b3-bf17a9421ed8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1538 microversion: 2.1 time: 0.298044 Apr 12 06:48:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 316/948] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:48:29 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1538 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-321a2f37-9622-4a21-b8fd-1b0a1c108df3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.095765 Apr 12 06:48:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 317/949] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:48:33 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:48:34 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:34 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e49df8a1-c1e5-453f-9359-870506616927 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/ips" status: 200 len: 110 microversion: 2.20 time: 0.039013 Apr 12 06:48:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 317/950] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 06:48:34 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:48:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Creating event network-changed:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:48:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099152 Apr 12 06:48:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 317/951] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:35 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'flavor' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:48:36 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/action" status: 202 len: 0 microversion: 2.20 time: 1.103157 Apr 12 06:48:36 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 318/952] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:48:35 2023] POST /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:37 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:48:37 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:48:37 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:48:37 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-26e223cc-9250-473b-9fc1-d0faf895ed47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1711 microversion: 2.20 time: 0.207216 Apr 12 06:48:37 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 318/953] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:48:36 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1711 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:48:37 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:37 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Creating event network-vif-unplugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:48:37 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095156 Apr 12 06:48:37 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 318/954] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:48:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035678 Apr 12 06:48:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 319/955] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:48:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:48:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:48:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:48:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:48:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Creating event network-changed:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:48:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045478 Apr 12 06:48:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 319/956] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:48:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] HTTP exception thrown: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Request method failure captured: Apr 12 06:49:00 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853 HTTP/1.1 Apr 12 06:49:00 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:49:00 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:49:00 user devstack@n-api.service[62040]: Connection: close Apr 12 06:49:00 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:49:00 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:49:00 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:49:00 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:49:00 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlO5KZ16KhHjIxm02HtsDi6rkgBKdpH2TdZYcFoZoDNSOoIbY4cr0xb4PCAIOOYUShO7Ma6VnggIE5MlIMukcigDbxL0RwAzIRWQWbTjwKLBIwPP1AY0-PqvM4wkH8kEqqtBVlv3NQU82bBxF2m9OwpW1Vvo-rCf8dPQ2lcHMPKhXYA Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Project-Id: 5098984b6bda4c2d9a71023292e7815c Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Project-Name: tempest-VolumesNegativeTest-289347363 Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5098984b6bda4c2d9a71023292e7815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5098984b6bda4c2d9a71023292e7815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5098984b6bda4c2d9a71023292e7815c"}]}] Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Tenant: tempest-VolumesNegativeTest-289347363 Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Tenant-Id: 5098984b6bda4c2d9a71023292e7815c Apr 12 06:49:00 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-VolumesNegativeTest-289347363 Apr 12 06:49:00 user devstack@n-api.service[62040]: X-User: tempest-VolumesNegativeTest-289347363-project-member Apr 12 06:49:00 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:49:00 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:49:00 user devstack@n-api.service[62040]: X-User-Id: c93cca7970df482f8c3a00f15ef12fde Apr 12 06:49:00 user devstack@n-api.service[62040]: X-User-Name: tempest-VolumesNegativeTest-289347363-project-member Apr 12 06:49:00 user devstack@n-api.service[62040]: method: > Apr 12 06:49:00 user devstack@n-api.service[62040]: exception: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. Apr 12 06:49:00 user devstack@n-api.service[62040]: action_args: {'id': '9b4783e1-34e3-425c-87c3-ee8bda2c6853'} Apr 12 06:49:00 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. Apr 12 06:49:00 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:49:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Returning 404 to user: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:49:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-30afed1f-8eba-4a7c-a902-173bc2cb87b4 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853" status: 404 len: 111 microversion: 2.1 time: 0.039507 Apr 12 06:49:00 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 319/957] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:00 2023] GET /compute/v2.1/servers/9b4783e1-34e3-425c-87c3-ee8bda2c6853 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-86781039", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "90fb009e-81f5-45c6-bbfe-8330a5ff1ac3", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] validate_networks() for [('9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:49:26 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='90fb009e-81f5-45c6-bbfe-8330a5ff1ac3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:49:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.551832 Apr 12 06:49:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 320/958] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:49:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:49:26 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:26 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=18 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:26 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-dfef5d9a-a262-4aab-b795-3c5743284ca2 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:26 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-dfef5d9a-a262-4aab-b795-3c5743284ca2 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:26 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-dfef5d9a-a262-4aab-b795-3c5743284ca2 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:26 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-dfef5d9a-a262-4aab-b795-3c5743284ca2 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 200 len: 1050 microversion: 2.1 time: 0.076828 Apr 12 06:49:26 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 320/959] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:26 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 1050 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:27 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2e942b4d-216a-42dc-a90c-b8251a80d3be tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1652 microversion: 2.20 time: 0.415174 Apr 12 06:49:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 320/960] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:49:27 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1652 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:49:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755c4de9-18c0-457d-b834-d21aab2141a8", "tag": "81437106-cc33-4c4b-ac7f-98d2393c84dc"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Creating event network-changed:81437106-cc33-4c4b-ac7f-98d2393c84dc for instance 755c4de9-18c0-457d-b834-d21aab2141a8 on user Apr 12 06:49:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035044 Apr 12 06:49:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 321/961] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:29 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-a3f62a36-8ab2-4fcf-b746-a5f9d365b1bc tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1538 microversion: 2.1 time: 0.142946 Apr 12 06:49:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 321/962] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:29 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1538 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching by: {'deleted': False, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc'} {{(pid=62040) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:29 user devstack@n-api.service[62040]: DEBUG nova.compute.multi_cell_list [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=62040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 06:49:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3860cc2a-f8a6-4a84-86a8-a93859cc58fb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.174986 Apr 12 06:49:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 321/963] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 06:49:29 2023] GET /compute/v2.1/servers => generated 341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:30 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:30 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6f086c4d-aff6-48a0-886b-bf2be9bbe709 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1538 microversion: 2.1 time: 0.135455 Apr 12 06:49:30 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 322/964] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:29 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1538 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e07c955b-abdd-446f-9137-d12aef35b2c5"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281025 Apr 12 06:49:31 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 322/965] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:49:31 2023] POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:39 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0dadb0b1-a0f1-4f41-a75d-f018f6ee27d5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1584 microversion: 2.1 time: 0.197812 Apr 12 06:49:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 322/966] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:39 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1584 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c4de9-18c0-457d-b834-d21aab2141a8", "name": "network-vif-plugged", "status": "completed", "tag": "81437106-cc33-4c4b-ac7f-98d2393c84dc"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:40 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Creating event network-vif-plugged:81437106-cc33-4c4b-ac7f-98d2393c84dc for instance 755c4de9-18c0-457d-b834-d21aab2141a8 on user Apr 12 06:49:40 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038379 Apr 12 06:49:40 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 323/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:49:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Creating event network-changed:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:49:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037322 Apr 12 06:49:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 323/968] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:42 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c4de9-18c0-457d-b834-d21aab2141a8", "name": "network-vif-plugged", "status": "completed", "tag": "81437106-cc33-4c4b-ac7f-98d2393c84dc"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:42 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Creating event network-vif-plugged:81437106-cc33-4c4b-ac7f-98d2393c84dc for instance 755c4de9-18c0-457d-b834-d21aab2141a8 on user Apr 12 06:49:42 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035174 Apr 12 06:49:42 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 323/969] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1692988691"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:43 user devstack@n-api.service[62041]: INFO nova.network.security_group_api [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Adding security group 4675be2e-ae12-4c6e-8882-86c2dd3cbe04 to port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 Apr 12 06:49:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6f0fbcf8-a572-4f82-86e1-f6237f8d85e0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/action" status: 202 len: 0 microversion: 2.1 time: 0.723587 Apr 12 06:49:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 324/970] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:49:43 2023] POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:49:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Creating event network-changed:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:49:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044820 Apr 12 06:49:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 324/971] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:43 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ee7863c3-2f0a-4ea9-aaa7-5e83441e5903 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1750 microversion: 2.1 time: 0.195973 Apr 12 06:49:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 324/972] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:43 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:46 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:46 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/action" status: 202 len: 0 microversion: 2.1 time: 0.093719 Apr 12 06:49:46 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 325/973] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:49:46 2023] POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:46 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:49:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e7c3d8a4-35c5-49d9-a409-cae899f7b0be tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1752 microversion: 2.1 time: 0.182517 Apr 12 06:49:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 325/974] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:49:46 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:49:47 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-unplugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:47 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:47 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:47 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:47 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Creating event network-vif-unplugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:49:47 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141080 Apr 12 06:49:47 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 325/975] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:49 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-plugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Creating event network-vif-plugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:49:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028882 Apr 12 06:49:49 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 326/976] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:51 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-plugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:51 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:51 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Creating event network-vif-plugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:49:52 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043957 Apr 12 06:49:52 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 326/977] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:49:54 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-plugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:49:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:49:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:49:54 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:49:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Creating event network-vif-plugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:49:54 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139425 Apr 12 06:49:54 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 326/978] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:49:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:16 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:50:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-1908e4ae-0087-47c0-b690-48454aafd862 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 200 len: 1377 microversion: 2.1 time: 0.174872 Apr 12 06:50:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 327/979] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:50:16 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 1377 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cbbb1a6-c094-4a11-beef-499b756020f2"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:27 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:27 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4cdbe405-c1d2-44f6-a9fa-9f30b392abe0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286635 Apr 12 06:50:27 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 327/980] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 06:50:27 2023] POST /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=14 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=32 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:28 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62040) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 06:50:28 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/action" status: 202 len: 0 microversion: 2.20 time: 0.227142 Apr 12 06:50:28 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 327/981] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:50:28 2023] POST /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:50:28 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:50:28 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-480bedb8-3a8c-4e1d-84d2-95acfc6e628c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1738 microversion: 2.20 time: 0.153522 Apr 12 06:50:28 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 328/982] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:50:28 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:50:35 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:50:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:35 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Creating event network-changed:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:50:35 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Apr 12 06:50:35 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 328/983] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:50:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:36 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:50:36 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-53a91684-55eb-4473-b956-b0ee49836091 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1750 microversion: 2.1 time: 0.193874 Apr 12 06:50:36 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 328/984] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:50:36 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:50:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:42 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:50:42 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:50:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:42 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:50:42 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059050 Apr 12 06:50:42 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 329/985] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:50:44 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:50:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:50:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:50:44 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:50:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:50:44 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033269 Apr 12 06:50:44 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 329/986] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:50:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:51:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-fc73bd83-4357-402e-8c95-127f87a9b2f6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 200 len: 1377 microversion: 2.1 time: 0.169511 Apr 12 06:51:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 329/987] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:51:17 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 1377 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:51:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-5fde34e1-4759-47a4-8ba2-e1fb17a3d53d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 200 len: 1377 microversion: 2.1 time: 0.169105 Apr 12 06:51:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 330/988] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:51:17 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 1377 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:51:17 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 204 len: 0 microversion: 2.1 time: 0.148091 Apr 12 06:51:17 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 330/989] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:51:17 2023] DELETE /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:51:17 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ed8204ba-de05-4a4b-b2d1-73e81f28f00c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 200 len: 1383 microversion: 2.1 time: 0.203960 Apr 12 06:51:17 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 330/990] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:51:17 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 1383 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c4de9-18c0-457d-b834-d21aab2141a8", "name": "network-vif-unplugged", "status": "completed", "tag": "81437106-cc33-4c4b-ac7f-98d2393c84dc"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Creating event network-vif-unplugged:81437106-cc33-4c4b-ac7f-98d2393c84dc for instance 755c4de9-18c0-457d-b834-d21aab2141a8 on user Apr 12 06:51:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028350 Apr 12 06:51:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 331/991] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:51:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:51:18 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:51:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-1b8a917c-e5c9-4278-808e-8a1429cabf69 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1783 microversion: 2.20 time: 0.213818 Apr 12 06:51:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 331/992] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:51:18 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1783 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:51:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c4de9-18c0-457d-b834-d21aab2141a8", "name": "network-vif-plugged", "status": "completed", "tag": "81437106-cc33-4c4b-ac7f-98d2393c84dc"}, {"server_uuid": "755c4de9-18c0-457d-b834-d21aab2141a8", "name": "network-vif-deleted", "tag": "81437106-cc33-4c4b-ac7f-98d2393c84dc"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:51:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Creating event network-vif-plugged:81437106-cc33-4c4b-ac7f-98d2393c84dc for instance 755c4de9-18c0-457d-b834-d21aab2141a8 on user Apr 12 06:51:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Creating event network-vif-deleted:81437106-cc33-4c4b-ac7f-98d2393c84dc for instance 755c4de9-18c0-457d-b834-d21aab2141a8 on user Apr 12 06:51:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033074 Apr 12 06:51:20 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 331/993] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:51:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1692988691"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:37 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:37 user devstack@n-api.service[62041]: INFO nova.network.security_group_api [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Removing security group 4675be2e-ae12-4c6e-8882-86c2dd3cbe04 from port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 Apr 12 06:51:37 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9e293122-47d4-4cd8-960e-849289548b1f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/action" status: 202 len: 0 microversion: 2.1 time: 0.658730 Apr 12 06:51:37 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 332/994] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:51:37 2023] POST /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:51:37 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:51:37 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:37 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Creating event network-changed:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:51:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054064 Apr 12 06:51:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 332/995] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=14 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:38 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'services' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:51:39 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments/e07c955b-abdd-446f-9137-d12aef35b2c5" status: 202 len: 0 microversion: 2.1 time: 0.192435 Apr 12 06:51:39 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 332/996] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:51:38 2023] DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments/e07c955b-abdd-446f-9137-d12aef35b2c5 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-dd08a89e-8392-4acd-a335-aff145792bf8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048674 Apr 12 06:51:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 333/997] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:51:39 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:51:40 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:51:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:51:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:51:40 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:51:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Creating event network-changed:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:51:40 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Apr 12 06:51:40 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 333/998] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:51:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:07 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:52:07 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 HTTP/1.1 Apr 12 06:52:07 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:52:07 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:52:07 user devstack@n-api.service[62040]: Connection: close Apr 12 06:52:07 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:52:07 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:52:07 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:52:07 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:52:07 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:52:07 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:07 user devstack@n-api.service[62040]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:52:07 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:52:07 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:52:07 user devstack@n-api.service[62040]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:52:07 user devstack@n-api.service[62040]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:52:07 user devstack@n-api.service[62040]: method: > Apr 12 06:52:07 user devstack@n-api.service[62040]: exception: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:07 user devstack@n-api.service[62040]: action_args: {'id': '755c4de9-18c0-457d-b834-d21aab2141a8'} Apr 12 06:52:07 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:07 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:07 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:52:07 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-c44ff333-01a5-497d-b641-44e2f714fc1e tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 404 len: 111 microversion: 2.1 time: 0.043669 Apr 12 06:52:07 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 333/999] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:52:07 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:52:08 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 HTTP/1.1 Apr 12 06:52:08 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:52:08 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:52:08 user devstack@n-api.service[62041]: Connection: close Apr 12 06:52:08 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:52:08 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:52:08 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:52:08 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:52:08 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:52:08 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:08 user devstack@n-api.service[62041]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:52:08 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:52:08 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:52:08 user devstack@n-api.service[62041]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:52:08 user devstack@n-api.service[62041]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:52:08 user devstack@n-api.service[62041]: method: > Apr 12 06:52:08 user devstack@n-api.service[62041]: exception: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62041]: action_args: {'id': '755c4de9-18c0-457d-b834-d21aab2141a8'} Apr 12 06:52:08 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:52:08 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6f3bbd94-c8bc-403b-ad8f-cfc863ac7599 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 404 len: 111 microversion: 2.1 time: 0.036413 Apr 12 06:52:08 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 334/1000] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:52:08 2023] DELETE /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:52:08 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 HTTP/1.1 Apr 12 06:52:08 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:52:08 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:52:08 user devstack@n-api.service[62042]: Connection: close Apr 12 06:52:08 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:52:08 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:52:08 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:52:08 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:52:08 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:52:08 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:52:08 user devstack@n-api.service[62042]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:52:08 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:52:08 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:52:08 user devstack@n-api.service[62042]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:52:08 user devstack@n-api.service[62042]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:52:08 user devstack@n-api.service[62042]: method: > Apr 12 06:52:08 user devstack@n-api.service[62042]: exception: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62042]: action_args: {'id': '755c4de9-18c0-457d-b834-d21aab2141a8'} Apr 12 06:52:08 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. Apr 12 06:52:08 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:52:08 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance 755c4de9-18c0-457d-b834-d21aab2141a8 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:52:08 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-398936f0-574b-4b9d-abeb-649f40672ffc tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8" status: 404 len: 111 microversion: 2.1 time: 0.039270 Apr 12 06:52:08 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 334/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:52:08 2023] GET /compute/v2.1/servers/755c4de9-18c0-457d-b834-d21aab2141a8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1017592903", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "c94a19e9-963c-4e8e-a613-6fc05da1dce3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] validate_networks() for [('9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:52:15 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c94a19e9-963c-4e8e-a613-6fc05da1dce3',volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:52:15 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.712250 Apr 12 06:52:15 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 334/1002] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:52:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:52:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-39a498d9-c8ab-4b80-b585-765a6505a119 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-39a498d9-c8ab-4b80-b585-765a6505a119 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:15 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-39a498d9-c8ab-4b80-b585-765a6505a119 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:52:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-39a498d9-c8ab-4b80-b585-765a6505a119 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 200 len: 1066 microversion: 2.1 time: 0.179494 Apr 12 06:52:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 335/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:52:15 2023] GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 1066 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:52:18 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13297b8-5f8a-46e8-8793-a092b5b4fc9e", "tag": "3d92724c-b271-4ead-a1b5-821d82d0ec85"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:18 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:18 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:18 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Creating event network-changed:3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e on user Apr 12 06:52:18 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040792 Apr 12 06:52:18 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 335/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:52:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:18 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2136329d-e4c9-41a4-a67d-ce33cb68e2e6 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments/9cbbb1a6-c094-4a11-beef-499b756020f2" status: 200 len: 194 microversion: 2.20 time: 0.145481 Apr 12 06:52:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 335/1005] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 06:52:18 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments/9cbbb1a6-c094-4a11-beef-499b756020f2 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:19 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'services' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:52:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments/9cbbb1a6-c094-4a11-beef-499b756020f2" status: 202 len: 0 microversion: 2.20 time: 0.168530 Apr 12 06:52:19 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 336/1006] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 06:52:19 2023] DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments/9cbbb1a6-c094-4a11-beef-499b756020f2 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-90953259-4f8c-407f-b2fa-39acf7c9fe20 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045591 Apr 12 06:52:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 336/1007] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 06:52:19 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:52:25 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13297b8-5f8a-46e8-8793-a092b5b4fc9e", "name": "network-vif-plugged", "status": "completed", "tag": "3d92724c-b271-4ead-a1b5-821d82d0ec85"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Creating event network-vif-plugged:3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e on user Apr 12 06:52:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047925 Apr 12 06:52:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 336/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:52:27 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:27 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13297b8-5f8a-46e8-8793-a092b5b4fc9e", "name": "network-vif-plugged", "status": "completed", "tag": "3d92724c-b271-4ead-a1b5-821d82d0ec85"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:27 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Creating event network-vif-plugged:3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e on user Apr 12 06:52:27 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Apr 12 06:52:27 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 337/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-44b9c3f4-58fe-4df1-8614-1fa4b7e25703 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043922 Apr 12 06:52:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 337/1010] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:52:29 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HTTP exception thrown: Instance 1d45a146-795c-455e-be0f-93227183720a is not attached to volume e07c955b-abdd-446f-9137-d12aef35b2c5 Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Request method failure captured: Apr 12 06:52:29 user devstack@n-api.service[62040]: request: DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments/e07c955b-abdd-446f-9137-d12aef35b2c5 HTTP/1.1 Apr 12 06:52:29 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:52:29 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:52:29 user devstack@n-api.service[62040]: Connection: close Apr 12 06:52:29 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:52:29 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:52:29 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:52:29 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:52:29 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlQBTcGdqOWqyz1wTJwyAfw1Z5VtQDH02OzFjOsBkajEFEPiLzT5NncWvhQkPYcydonmjF8tBZvm-hFlPNM1LKE0TqQiifsN4OZYXkFl1OOqIsT4lI9gTLCxDFNcbeJz5GNPBDH6P0_X-QURs2SZi1v8dVCSRJarizdEqsfCaYEroTA Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Project-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}] Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Tenant: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Tenant-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:52:29 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:52:29 user devstack@n-api.service[62040]: X-User: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:52:29 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:52:29 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:52:29 user devstack@n-api.service[62040]: X-User-Id: 2a188723ace3460792ed32d13bfe0d93 Apr 12 06:52:29 user devstack@n-api.service[62040]: X-User-Name: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:52:29 user devstack@n-api.service[62040]: method: > Apr 12 06:52:29 user devstack@n-api.service[62040]: exception: Instance 1d45a146-795c-455e-be0f-93227183720a is not attached to volume e07c955b-abdd-446f-9137-d12aef35b2c5 Apr 12 06:52:29 user devstack@n-api.service[62040]: action_args: {'server_id': '1d45a146-795c-455e-be0f-93227183720a', 'id': 'e07c955b-abdd-446f-9137-d12aef35b2c5'} Apr 12 06:52:29 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e07c955b-abdd-446f-9137-d12aef35b2c5. Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d45a146-795c-455e-be0f-93227183720a is not attached to volume e07c955b-abdd-446f-9137-d12aef35b2c5 Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d45a146-795c-455e-be0f-93227183720a is not attached to volume e07c955b-abdd-446f-9137-d12aef35b2c5 Apr 12 06:52:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:52:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Returning 404 to user: Instance 1d45a146-795c-455e-be0f-93227183720a is not attached to volume e07c955b-abdd-446f-9137-d12aef35b2c5 {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:52:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b11e0259-0061-4042-b437-395f7356a065 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments/e07c955b-abdd-446f-9137-d12aef35b2c5" status: 404 len: 154 microversion: 2.1 time: 0.166385 Apr 12 06:52:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 337/1011] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:52:29 2023] DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a/os-volume_attachments/e07c955b-abdd-446f-9137-d12aef35b2c5 => generated 154 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:31 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:52:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 204 len: 0 microversion: 2.1 time: 0.205089 Apr 12 06:52:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 338/1012] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:52:31 2023] DELETE /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:31 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:52:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c5d7923a-338f-40c5-b0f5-30f7a78993f8 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 200 len: 1544 microversion: 2.1 time: 0.165826 Apr 12 06:52:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 338/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:52:31 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 1544 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:52:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-unplugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Creating event network-vif-unplugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:52:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035502 Apr 12 06:52:32 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 338/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:52:33 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-deleted", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:33 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] Creating event network-vif-deleted:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:52:33 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Apr 12 06:52:33 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 339/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:52:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:52:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45a146-795c-455e-be0f-93227183720a", "name": "network-vif-plugged", "status": "completed", "tag": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:52:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:52:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:52:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:52:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Creating event network-vif-plugged:37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance 1d45a146-795c-455e-be0f-93227183720a on user Apr 12 06:52:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034267 Apr 12 06:52:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 339/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:52:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=20 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:06 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:53:06 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0ff2d2d5-d5fe-435d-af7e-5144631edf80 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 200 len: 1392 microversion: 2.1 time: 0.216098 Apr 12 06:53:06 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 339/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:53:06 2023] GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-3c2687a7-5928-4a83-bd17-13d2bedef14f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052351 Apr 12 06:53:09 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 340/1018] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 06:53:09 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=22 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:53:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 204 len: 0 microversion: 2.20 time: 0.130127 Apr 12 06:53:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 340/1019] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:53:09 2023] DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:53:09 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:53:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-8564b298-1ca3-4149-b32c-50a7b09c1e9c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 200 len: 1711 microversion: 2.20 time: 0.241260 Apr 12 06:53:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 340/1020] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:53:09 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 1711 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Creating event network-vif-unplugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030394 Apr 12 06:53:09 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 341/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:53:11 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}, {"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}, {"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}, {"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}, {"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-plugged", "status": "completed", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}, {"server_uuid": "02209375-f25a-4d51-9828-3422144c2ed8", "name": "network-vif-deleted", "tag": "e6c75186-26c0-414f-9dfe-13cb03283057"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:11 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Creating event network-vif-unplugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Creating event network-vif-plugged:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Creating event network-vif-deleted:e6c75186-26c0-414f-9dfe-13cb03283057 for instance 02209375-f25a-4d51-9828-3422144c2ed8 on user Apr 12 06:53:11 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.033371 Apr 12 06:53:11 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 341/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:22 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HTTP exception thrown: Instance 1d45a146-795c-455e-be0f-93227183720a could not be found. Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Request method failure captured: Apr 12 06:53:22 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a HTTP/1.1 Apr 12 06:53:22 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:53:22 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:53:22 user devstack@n-api.service[62040]: Connection: close Apr 12 06:53:22 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:53:22 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:53:22 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:53:22 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:53:22 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlQBTcGdqOWqyz1wTJwyAfw1Z5VtQDH02OzFjOsBkajEFEPiLzT5NncWvhQkPYcydonmjF8tBZvm-hFlPNM1LKE0TqQiifsN4OZYXkFl1OOqIsT4lI9gTLCxDFNcbeJz5GNPBDH6P0_X-QURs2SZi1v8dVCSRJarizdEqsfCaYEroTA Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Project-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}] Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Tenant: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Tenant-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:53:22 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:53:22 user devstack@n-api.service[62040]: X-User: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:53:22 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:53:22 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:53:22 user devstack@n-api.service[62040]: X-User-Id: 2a188723ace3460792ed32d13bfe0d93 Apr 12 06:53:22 user devstack@n-api.service[62040]: X-User-Name: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:53:22 user devstack@n-api.service[62040]: method: > Apr 12 06:53:22 user devstack@n-api.service[62040]: exception: Instance 1d45a146-795c-455e-be0f-93227183720a could not be found. Apr 12 06:53:22 user devstack@n-api.service[62040]: action_args: {'id': '1d45a146-795c-455e-be0f-93227183720a'} Apr 12 06:53:22 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d45a146-795c-455e-be0f-93227183720a could not be found. Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d45a146-795c-455e-be0f-93227183720a could not be found. Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d45a146-795c-455e-be0f-93227183720a could not be found. Apr 12 06:53:22 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:53:22 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Returning 404 to user: Instance 1d45a146-795c-455e-be0f-93227183720a could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:53:22 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1d6a49b3-6d09-4f40-9637-eb0940d00b20 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a" status: 404 len: 111 microversion: 2.1 time: 0.144268 Apr 12 06:53:22 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 341/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:53:22 2023] GET /compute/v2.1/servers/1d45a146-795c-455e-be0f-93227183720a => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:53:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-da738906-bf35-401a-bc82-fd366e48b123 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '.version_select at 0x7fd24e082320>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:22 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-da738906-bf35-401a-bc82-fd366e48b123 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1175210425" status: 202 len: 0 microversion: 2.1 time: 0.029005 Apr 12 06:53:22 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 342/1024] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 06:53:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1175210425 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:53:24 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:24 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:24 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d3685f27-f428-4c91-946f-3692a021d4c7 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'create', calling method: .version_select at 0x7fd24e041d80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-709112217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8omkAJ5QHXkbKVRiHFVG85cy80mBAbjxhQvXag1lrvEbH1vHi0AGYDPUpjAceyOw/UFX83aigQSWD29PXNlZ1i7g1u31wJY0pxuKqHAxdqoT9OXDVoKHd5rVyKkUvLww=="}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:24 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-d3685f27-f428-4c91-946f-3692a021d4c7 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:53:24 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-d3685f27-f428-4c91-946f-3692a021d4c7 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for user 2a188723ace3460792ed32d13bfe0d93 and project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'key_pairs'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:53:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d3685f27-f428-4c91-946f-3692a021d4c7 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.085031 Apr 12 06:53:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 342/1025] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:53:24 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:53:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1315008543", "imageRef": "f80d148a-a25f-4656-aa33-568629afd9ae", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-709112217", "networks": [{"uuid": "e15834f3-3252-4493-9d01-4c068834b98e"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:24 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] validate_networks() for [('e15834f3-3252-4493-9d01-4c068834b98e', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting quotas for user 2a188723ace3460792ed32d13bfe0d93 and project d1aacffb9fbd4398b98db1f1945138dc. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:53:25 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f80d148a-a25f-4656-aa33-568629afd9ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:53:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.718310 Apr 12 06:53:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 342/1026] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:53:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:53:25 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-76f6d9d4-bac6-4288-8593-cd1640f4ad38 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:25 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-76f6d9d4-bac6-4288-8593-cd1640f4ad38 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:25 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-76f6d9d4-bac6-4288-8593-cd1640f4ad38 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:53:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-76f6d9d4-bac6-4288-8593-cd1640f4ad38 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1252 microversion: 2.1 time: 0.113345 Apr 12 06:53:25 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 343/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:53:25 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1252 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:53:28 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:28 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Creating event network-changed:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:53:28 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032367 Apr 12 06:53:28 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 343/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:53:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:53:30 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:30 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:53:30 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036157 Apr 12 06:53:30 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 343/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:53:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:53:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:53:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:53:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044749 Apr 12 06:53:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 344/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:53:59 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HTTP exception thrown: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Request method failure captured: Apr 12 06:53:59 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 HTTP/1.1 Apr 12 06:53:59 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:53:59 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:53:59 user devstack@n-api.service[62042]: Connection: close Apr 12 06:53:59 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:53:59 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:53:59 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:53:59 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:53:59 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlPQYbntyM8nsHN8UwppDvju43uJTplHC5OfARBaETQZTSr3TWZQjB0l5Ta8IrFXzHwixdIz1MCQ3UuinQXvpxE5BizXqmsKlifVAM5IR07HkeqmCxs3ePpSshNp5Pf-8FMPhkXZh_f5Ij4DXgHvcwP_2HO63h64b6muic55A3eFxkI Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Project-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}] Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Tenant-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 06:53:59 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:53:59 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:53:59 user devstack@n-api.service[62042]: X-User-Id: 4fbb8c37e5a74a0b83011c2a21033204 Apr 12 06:53:59 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 06:53:59 user devstack@n-api.service[62042]: method: > Apr 12 06:53:59 user devstack@n-api.service[62042]: exception: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 06:53:59 user devstack@n-api.service[62042]: action_args: {'id': '02209375-f25a-4d51-9828-3422144c2ed8'} Apr 12 06:53:59 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 06:53:59 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:53:59 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Returning 404 to user: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:53:59 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-63dcdd23-b9a2-4aa3-a4e0-2718d82ddfd4 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 404 len: 111 microversion: 2.20 time: 0.043789 Apr 12 06:53:59 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 344/1031] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:53:59 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 06:53:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:53:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-1d2210c6-6bd7-4e07-a5cb-f3d099d1bf00 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '.version_select at 0x7fd24dcdbeb0>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-1d2210c6-6bd7-4e07-a5cb-f3d099d1bf00 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914952928" status: 204 len: 0 microversion: 2.20 time: 0.037260 Apr 12 06:54:00 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 344/1032] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 06:53:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914952928 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:54:01 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-e3b64573-1a46-43f4-8707-a069fb169a1c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'create', calling method: .version_select at 0x7fd24e082680>, body: {"keypair": {"name": "tempest-keypair-1503210292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZatAJqhPRKbsg3G5XFC/JkrKoFRPA+0R2UIBKzFMOJlUFJ6rJIELVTlaoiATccS59Gqp4lgra8q75tm0fDyDA6b//ESxqIoXD4S2MxQGGB56gMpEm5qcZHQfzxVjPWzQ=="}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:01 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:01 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-e3b64573-1a46-43f4-8707-a069fb169a1c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:54:01 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-e3b64573-1a46-43f4-8707-a069fb169a1c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for user 4fbb8c37e5a74a0b83011c2a21033204 and project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'key_pairs'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:54:01 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-e3b64573-1a46-43f4-8707-a069fb169a1c tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050704 Apr 12 06:54:01 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 345/1033] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 06:54:01 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1061983954", "imageRef": "4f2549ed-915f-4494-87f3-9269834fa9da", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f1744f20-6d53-4995-b638-1b500b3a999a"}], "security_groups": [{"name": "tempest-securitygroup--1571090759"}], "key_name": "tempest-keypair-1503210292", "user_data": "}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] validate_networks() for [('f1744f20-6d53-4995-b638-1b500b3a999a', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:02 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:03 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:54:03 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting quotas for user 4fbb8c37e5a74a0b83011c2a21033204 and project 76a8460ce5c24d1db20e80a1659133f7. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:54:03 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:54:03 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f2549ed-915f-4494-87f3-9269834fa9da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:54:03 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.664281 Apr 12 06:54:03 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 345/1034] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 06:54:02 2023] POST /compute/v2.1/servers => generated 400 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 06:54:03 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-821786a6-09a8-4d69-8660-4d0f5312c9df tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:03 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-821786a6-09a8-4d69-8660-4d0f5312c9df tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-821786a6-09a8-4d69-8660-4d0f5312c9df tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-821786a6-09a8-4d69-8660-4d0f5312c9df tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:03 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-821786a6-09a8-4d69-8660-4d0f5312c9df tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:03 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-821786a6-09a8-4d69-8660-4d0f5312c9df tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1276 microversion: 2.20 time: 0.070418 Apr 12 06:54:03 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 345/1035] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:54:03 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1276 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:54:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Creating event network-changed:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:54:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083522 Apr 12 06:54:05 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 346/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:54:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:06 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:06 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-99a7a8c0-53ae-40f1-8f8f-1e255199c3a7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 200 len: 1392 microversion: 2.1 time: 0.149300 Apr 12 06:54:06 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 346/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:54:06 2023] GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-943632025"}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:06 user devstack@n-api.service[62040]: INFO nova.compute.api [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Attempting to quiesce instance before volume snapshot. Apr 12 06:54:06 user devstack@n-api.service[62040]: INFO nova.compute.api [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 06:54:06 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Creating snapshot from volume c94a19e9-963c-4e8e-a613-6fc05da1dce3. {{(pid=62040) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 06:54:07 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-plugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:07 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:07 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Creating event network-vif-plugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:54:07 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038520 Apr 12 06:54:07 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 347/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:54:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:54:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4b7d2eb0-51c7-4f4f-8a40-3885d68e753a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e/action" status: 202 len: 0 microversion: 2.1 time: 2.489638 Apr 12 06:54:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 346/1039] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:54:06 2023] POST /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e/action => generated 0 bytes in 2491 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1691787741", "imageRef": "0e1f547a-cb9b-4ce7-852c-deedf527cce8", "flavorRef": "42", "networks": [{"uuid": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a"}]}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] validate_networks() for [('9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a', None, None, None, None, None)] {{(pid=62042) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:09 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-plugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:54:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:09 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.quota [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:54:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Creating event network-vif-plugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Going to run 1 instances... {{(pid=62042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:54:09 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d8878eba-66cc-4e86-a34a-d46c8c7499ea',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:54:09 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028357 Apr 12 06:54:09 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 348/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:54:09 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.561459 Apr 12 06:54:09 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 347/1041] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:54:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:54:09 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-14ca8b66-1925-470d-a3c7-646cc051a603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:09 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-14ca8b66-1925-470d-a3c7-646cc051a603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:09 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-14ca8b66-1925-470d-a3c7-646cc051a603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:09 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-14ca8b66-1925-470d-a3c7-646cc051a603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 200 len: 1224 microversion: 2.1 time: 0.082608 Apr 12 06:54:09 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 347/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:54:09 2023] GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:54:12 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:12 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d338017f-0ae6-42dd-8015-68522ff99de8", "tag": "97277a3a-a7de-4c39-8a7e-9fc88572f072"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:12 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Creating event network-changed:97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance d338017f-0ae6-42dd-8015-68522ff99de8 on user Apr 12 06:54:12 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030874 Apr 12 06:54:12 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 349/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:54:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:15 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:15 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3178e201-2e22-4058-95f9-390de245dd24 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1536 microversion: 2.1 time: 0.227336 Apr 12 06:54:15 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 348/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:54:15 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1536 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d338017f-0ae6-42dd-8015-68522ff99de8", "name": "network-vif-plugged", "status": "completed", "tag": "97277a3a-a7de-4c39-8a7e-9fc88572f072"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Creating event network-vif-plugged:97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance d338017f-0ae6-42dd-8015-68522ff99de8 on user Apr 12 06:54:24 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049916 Apr 12 06:54:24 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 348/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:54:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:54:26 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:26 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:26 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d338017f-0ae6-42dd-8015-68522ff99de8", "name": "network-vif-plugged", "status": "completed", "tag": "97277a3a-a7de-4c39-8a7e-9fc88572f072"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:54:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:26 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Creating event network-vif-plugged:97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance d338017f-0ae6-42dd-8015-68522ff99de8 on user Apr 12 06:54:26 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042420 Apr 12 06:54:26 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 350/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:54:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=12 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=18 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:53 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c58875ea-5d2e-455a-b7d8-0cdbf801e7de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1588 microversion: 2.20 time: 0.166167 Apr 12 06:54:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 349/1047] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:54:53 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1588 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:54:59 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:54:59 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-2715a160-68b0-43ea-b580-c1f203a89ca8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 200 len: 1551 microversion: 2.1 time: 0.154877 Apr 12 06:54:59 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 349/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:54:59 2023] GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:15 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:15 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-6296ef6d-f48e-4577-b304-77a450f049a9 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1536 microversion: 2.1 time: 0.149341 Apr 12 06:55:15 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 351/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:55:15 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1536 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching by: {'deleted': False, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc'} {{(pid=62042) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:15 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:16 user devstack@n-api.service[62042]: DEBUG nova.compute.multi_cell_list [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=62042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 06:55:16 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-92fb6519-4d47-4354-bf0e-71b188e92834 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.180989 Apr 12 06:55:16 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 350/1050] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 06:55:15 2023] GET /compute/v2.1/servers => generated 341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:16 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:16 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-ca997bb5-c4d1-43b9-b800-c3b9663c4d71 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1536 microversion: 2.1 time: 0.156415 Apr 12 06:55:16 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 350/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:55:16 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1536 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d566ec-564b-4062-9a9a-09066ee60704"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:17 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:18 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277113 Apr 12 06:55:18 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 352/1052] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 06:55:17 2023] POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:25 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:25 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3a1b7bed-f319-42d2-9661-9e8dfd4d48ad tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1582 microversion: 2.1 time: 0.187142 Apr 12 06:55:25 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 351/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:55:25 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1582 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:55:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:27 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Creating event network-changed:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:55:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038380 Apr 12 06:55:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 351/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1415745825"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:28 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:28 user devstack@n-api.service[62041]: INFO nova.network.security_group_api [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Adding security group 4d980a2a-b473-4991-ac9c-a243b86f692d to port b99eaecc-c588-46cb-84bf-10c63272eebf Apr 12 06:55:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c77db83e-047c-4957-8721-b3b7590fbdf5 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/action" status: 202 len: 0 microversion: 2.1 time: 0.583933 Apr 12 06:55:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 353/1055] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:55:28 2023] POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Creating event network-changed:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:55:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094450 Apr 12 06:55:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 352/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:29 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0028e80d-c44f-4782-a69e-9dc3ea57e34d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1748 microversion: 2.1 time: 0.168077 Apr 12 06:55:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 352/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:55:29 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/action" status: 202 len: 0 microversion: 2.1 time: 0.093270 Apr 12 06:55:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 354/1058] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:55:29 2023] POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:29 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:29 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-7cf36205-58a4-4975-b632-bdc852c6892f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1740 microversion: 2.1 time: 0.162206 Apr 12 06:55:29 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 353/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:55:29 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:55:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Creating event network-vif-unplugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:55:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066982 Apr 12 06:55:32 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 353/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:34 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}, {"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:34 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:55:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:55:34 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070185 Apr 12 06:55:34 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 355/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:36 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:36 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:55:36 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Apr 12 06:55:36 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 354/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7de191f3-be89-4eb6-9822-f44759646ddf tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.107615 Apr 12 06:55:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 354/1063] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 06:55:53 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-interface => generated 282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:55:54 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:54 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:54 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=10 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=24 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:55:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:54 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Creating event network-changed:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:54 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:54 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080838 Apr 12 06:55:54 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 356/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:54 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d00da79b-79ca-4e27-ab32-0f1e1fd91b4f tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/ips" status: 200 len: 110 microversion: 2.20 time: 0.040864 Apr 12 06:55:54 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 355/1065] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 06:55:54 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:55 user devstack@n-api.service[62040]: DEBUG nova.objects.instance [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'flavor' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=62040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:55:56 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/action" status: 202 len: 0 microversion: 2.20 time: 0.756233 Apr 12 06:55:56 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 355/1066] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:55:55 2023] POST /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:56 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:55:56 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b8128dcb-6eb5-42a2-bc89-efac858bd54e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1713 microversion: 2.20 time: 0.185324 Apr 12 06:55:56 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 357/1067] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:55:56 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1713 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:55:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-unplugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Creating event network-vif-unplugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:55:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029409 Apr 12 06:55:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 356/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:55:58 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-plugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:55:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:55:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:55:58 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:55:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Creating event network-vif-plugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:55:58 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037129 Apr 12 06:55:58 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 356/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-59ab1f2d-8d3b-49ef-ac21-dd3d8883c148 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 200 len: 1551 microversion: 2.1 time: 0.146200 Apr 12 06:56:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 358/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:56:00 2023] GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 1551 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:56:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 204 len: 0 microversion: 2.1 time: 0.116325 Apr 12 06:56:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 357/1071] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:56:00 2023] DELETE /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:00 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-7c048c3d-3a7c-4a12-83dd-dcd865fa067f tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 200 len: 1557 microversion: 2.1 time: 0.195190 Apr 12 06:56:00 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 357/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:56:00 2023] GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d338017f-0ae6-42dd-8015-68522ff99de8", "name": "network-vif-unplugged", "status": "completed", "tag": "97277a3a-a7de-4c39-8a7e-9fc88572f072"}, {"server_uuid": "d338017f-0ae6-42dd-8015-68522ff99de8", "name": "network-vif-plugged", "status": "completed", "tag": "97277a3a-a7de-4c39-8a7e-9fc88572f072"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:56:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Creating event network-vif-unplugged:97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance d338017f-0ae6-42dd-8015-68522ff99de8 on user Apr 12 06:56:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Creating event network-vif-plugged:97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance d338017f-0ae6-42dd-8015-68522ff99de8 on user Apr 12 06:56:00 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.027652 Apr 12 06:56:00 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 359/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:56:00 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:00 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Creating event network-changed:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:56:00 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037645 Apr 12 06:56:00 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 358/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:56:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:56:02 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d338017f-0ae6-42dd-8015-68522ff99de8", "name": "network-vif-deleted", "tag": "97277a3a-a7de-4c39-8a7e-9fc88572f072"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:56:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:02 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:02 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] Creating event network-vif-deleted:97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance d338017f-0ae6-42dd-8015-68522ff99de8 on user Apr 12 06:56:02 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035223 Apr 12 06:56:02 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 358/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=8 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=16 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:19 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2e57ef09-446b-465a-8946-a4db812a8f78 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1748 microversion: 2.1 time: 0.169185 Apr 12 06:56:19 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 360/1076] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:56:19 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:46 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:46 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3a26b4d6-8f6f-4d1b-a915-f72a7dcaa208 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1654 microversion: 2.20 time: 0.165722 Apr 12 06:56:46 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 359/1077] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:56:46 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:56:50 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 HTTP/1.1 Apr 12 06:56:50 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:56:50 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:56:50 user devstack@n-api.service[62040]: Connection: close Apr 12 06:56:50 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:56:50 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:56:50 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:56:50 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:56:50 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:56:50 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:56:50 user devstack@n-api.service[62040]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:56:50 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:56:50 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:56:50 user devstack@n-api.service[62040]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:56:50 user devstack@n-api.service[62040]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:56:50 user devstack@n-api.service[62040]: method: > Apr 12 06:56:50 user devstack@n-api.service[62040]: exception: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:56:50 user devstack@n-api.service[62040]: action_args: {'id': 'd338017f-0ae6-42dd-8015-68522ff99de8'} Apr 12 06:56:50 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:56:50 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:56:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:56:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-852da8a2-0f86-4412-9535-40d50f587365 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 404 len: 111 microversion: 2.1 time: 0.036169 Apr 12 06:56:50 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 359/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:56:50 2023] GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:52 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:56:53 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 204 len: 0 microversion: 2.1 time: 0.108846 Apr 12 06:56:53 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 361/1079] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:56:52 2023] DELETE /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:53 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:56:53 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-db4bda09-8992-48d0-821b-f60b9a7a88e7 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 200 len: 1398 microversion: 2.1 time: 0.196457 Apr 12 06:56:53 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 360/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:56:53 2023] GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 1398 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:56:53 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13297b8-5f8a-46e8-8793-a092b5b4fc9e", "name": "network-vif-unplugged", "status": "completed", "tag": "3d92724c-b271-4ead-a1b5-821d82d0ec85"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:56:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:53 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Creating event network-vif-unplugged:3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e on user Apr 12 06:56:53 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029118 Apr 12 06:56:53 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 360/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:56:55 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13297b8-5f8a-46e8-8793-a092b5b4fc9e", "name": "network-vif-plugged", "status": "completed", "tag": "3d92724c-b271-4ead-a1b5-821d82d0ec85"}, {"server_uuid": "e13297b8-5f8a-46e8-8793-a092b5b4fc9e", "name": "network-vif-deleted", "tag": "3d92724c-b271-4ead-a1b5-821d82d0ec85"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:56:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:56:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:56:55 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:56:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Creating event network-vif-plugged:3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e on user Apr 12 06:56:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Creating event network-vif-deleted:3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e on user Apr 12 06:56:55 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029875 Apr 12 06:56:55 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 362/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1415745825"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=12 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:20 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:20 user devstack@n-api.service[62042]: INFO nova.network.security_group_api [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Removing security group 4d980a2a-b473-4991-ac9c-a243b86f692d from port b99eaecc-c588-46cb-84bf-10c63272eebf Apr 12 06:57:20 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-119a8040-1b71-4dcb-8c9a-63bc17328770 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/action" status: 202 len: 0 microversion: 2.1 time: 0.565729 Apr 12 06:57:20 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 361/1083] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 06:57:20 2023] POST /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:57:20 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:20 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:20 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:20 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Creating event network-changed:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:57:20 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034312 Apr 12 06:57:20 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 361/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:21 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:21 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Creating event network-changed:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:57:21 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029520 Apr 12 06:57:21 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 362/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:21 user devstack@n-api.service[62041]: DEBUG nova.objects.instance [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'services' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=62041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 06:57:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments/98d566ec-564b-4062-9a9a-09066ee60704" status: 202 len: 0 microversion: 2.1 time: 0.282639 Apr 12 06:57:21 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 363/1086] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:57:21 2023] DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments/98d566ec-564b-4062-9a9a-09066ee60704 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4abe588b-9781-46cd-9ec4-376b2eb3151f tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049836 Apr 12 06:57:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 362/1087] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:57:21 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:57:43 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e HTTP/1.1 Apr 12 06:57:43 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:57:43 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:57:43 user devstack@n-api.service[62042]: Connection: close Apr 12 06:57:43 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:57:43 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:57:43 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:57:43 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:57:43 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62042]: method: > Apr 12 06:57:43 user devstack@n-api.service[62042]: exception: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: action_args: {'id': 'e13297b8-5f8a-46e8-8793-a092b5b4fc9e'} Apr 12 06:57:43 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:57:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-e2ac0d41-b1a2-4dad-b24b-474693b3325a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 404 len: 111 microversion: 2.1 time: 0.035229 Apr 12 06:57:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 363/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:57:43 2023] GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:57:43 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 HTTP/1.1 Apr 12 06:57:43 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:57:43 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:57:43 user devstack@n-api.service[62041]: Connection: close Apr 12 06:57:43 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:57:43 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:57:43 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:57:43 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:57:43 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62041]: method: > Apr 12 06:57:43 user devstack@n-api.service[62041]: exception: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: action_args: {'id': 'd338017f-0ae6-42dd-8015-68522ff99de8'} Apr 12 06:57:43 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:57:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7a580f44-bf1c-48b2-99c9-0014007db5dd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 404 len: 111 microversion: 2.1 time: 0.034264 Apr 12 06:57:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 364/1089] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:57:43 2023] DELETE /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=8 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:57:43 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 HTTP/1.1 Apr 12 06:57:43 user devstack@n-api.service[62040]: Accept: application/json Apr 12 06:57:43 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 06:57:43 user devstack@n-api.service[62040]: Connection: close Apr 12 06:57:43 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 06:57:43 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 06:57:43 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 06:57:43 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 06:57:43 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62040]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62040]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:57:43 user devstack@n-api.service[62040]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62040]: method: > Apr 12 06:57:43 user devstack@n-api.service[62040]: exception: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62040]: action_args: {'id': 'd338017f-0ae6-42dd-8015-68522ff99de8'} Apr 12 06:57:43 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. Apr 12 06:57:43 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance d338017f-0ae6-42dd-8015-68522ff99de8 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:57:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-50fb4028-4746-4d6e-81d4-1bc24930afbd tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8" status: 404 len: 111 microversion: 2.1 time: 0.032090 Apr 12 06:57:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 363/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:57:43 2023] GET /compute/v2.1/servers/d338017f-0ae6-42dd-8015-68522ff99de8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:57:43 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e HTTP/1.1 Apr 12 06:57:43 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:57:43 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:57:43 user devstack@n-api.service[62042]: Connection: close Apr 12 06:57:43 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:57:43 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:57:43 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:57:43 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:57:43 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:57:43 user devstack@n-api.service[62042]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62042]: method: > Apr 12 06:57:43 user devstack@n-api.service[62042]: exception: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: action_args: {'id': 'e13297b8-5f8a-46e8-8793-a092b5b4fc9e'} Apr 12 06:57:43 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:57:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d9cbd386-5678-4449-b488-947fe21559c8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 404 len: 111 microversion: 2.1 time: 0.038729 Apr 12 06:57:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 364/1091] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:57:43 2023] DELETE /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 06:57:43 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e HTTP/1.1 Apr 12 06:57:43 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:57:43 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:57:43 user devstack@n-api.service[62041]: Connection: close Apr 12 06:57:43 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:57:43 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:57:43 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:57:43 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:57:43 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 06:57:43 user devstack@n-api.service[62041]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 06:57:43 user devstack@n-api.service[62041]: method: > Apr 12 06:57:43 user devstack@n-api.service[62041]: exception: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: action_args: {'id': 'e13297b8-5f8a-46e8-8793-a092b5b4fc9e'} Apr 12 06:57:43 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. Apr 12 06:57:43 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:57:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:57:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-67cc8386-bd10-44fc-a835-8d0b25380548 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e" status: 404 len: 111 microversion: 2.1 time: 0.027801 Apr 12 06:57:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 365/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:57:43 2023] GET /compute/v2.1/servers/e13297b8-5f8a-46e8-8793-a092b5b4fc9e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-372900f9-eb58-43a8-aed8-34af1ec92b52 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: .version_select at 0x7fd24ddf9ab0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1253801261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA=="}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-372900f9-eb58-43a8-aed8-34af1ec92b52 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:57:43 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-372900f9-eb58-43a8-aed8-34af1ec92b52 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'key_pairs'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:57:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-372900f9-eb58-43a8-aed8-34af1ec92b52 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049473 Apr 12 06:57:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 364/1093] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 06:57:43 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6550026c-a3ce-49ae-8fa4-8a420acf0814"}} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-120b7118-505c-408c-8399-0e01286c8280 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.350451 Apr 12 06:57:47 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 365/1094] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 06:57:47 2023] POST /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-volume_attachments => generated 188 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-569607723", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1253801261", "security_groups": [{"name": "tempest-secgroup-smoke-1366870723"}], "block_device_mapping_v2": [{"uuid": "1640bd09-1264-4e82-9e6e-0f1fa3cc654b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:47 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-fc9b3a44-f334-4276-ae23-d583270491da tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-volume_attachments/6550026c-a3ce-49ae-8fa4-8a420acf0814" status: 202 len: 0 microversion: 2.20 time: 0.230879 Apr 12 06:57:47 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 366/1095] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 06:57:47 2023] DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-volume_attachments/6550026c-a3ce-49ae-8fa4-8a420acf0814 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62042) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 06:57:47 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] validate_networks() for [('9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 06:57:47 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/action" status: 202 len: 0 microversion: 2.20 time: 0.124413 Apr 12 06:57:47 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 366/1096] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 06:57:47 2023] POST /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:47 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:48 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:57:48 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:57:48 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:57:48 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-54481268-cb00-4cbc-aff8-ca70cae1bf68 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1662 microversion: 2.20 time: 0.153931 Apr 12 06:57:48 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 367/1097] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:57:47 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 06:57:48 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1640bd09-1264-4e82-9e6e-0f1fa3cc654b',volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 06:57:48 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.791553 Apr 12 06:57:48 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 365/1098] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 06:57:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 06:57:48 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-53effc6c-6180-4fd8-962e-17dbb88a8df8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:57:48 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-53effc6c-6180-4fd8-962e-17dbb88a8df8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:57:48 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-53effc6c-6180-4fd8-962e-17dbb88a8df8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:57:48 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-53effc6c-6180-4fd8-962e-17dbb88a8df8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 200 len: 1089 microversion: 2.1 time: 0.062705 Apr 12 06:57:48 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 367/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:57:48 2023] GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:57:49 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:49 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Creating event network-changed:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:57:49 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Apr 12 06:57:49 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 368/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:57:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:50 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:50 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Creating event network-changed:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:57:50 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062253 Apr 12 06:57:50 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 366/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:56 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-plugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:56 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Creating event network-vif-plugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:57:56 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038692 Apr 12 06:57:56 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 368/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:57:58 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-plugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}, {"server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "name": "network-vif-plugged", "status": "completed", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}, {"server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "name": "network-vif-plugged", "status": "completed", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:57:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:57:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:57:58 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:57:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Creating event network-vif-plugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:57:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Creating event network-vif-plugged:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:57:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Creating event network-vif-plugged:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:57:58 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036670 Apr 12 06:57:58 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 369/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:57:58 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=10 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:12 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:12 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0aab2208-1c11-4fa7-9dc0-89862f783853 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062699 Apr 12 06:58:12 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 367/1104] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 06:58:12 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HTTP exception thrown: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is not attached to volume 98d566ec-564b-4062-9a9a-09066ee60704 Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Request method failure captured: Apr 12 06:58:12 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments/98d566ec-564b-4062-9a9a-09066ee60704 HTTP/1.1 Apr 12 06:58:12 user devstack@n-api.service[62042]: Accept: application/json Apr 12 06:58:12 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 06:58:12 user devstack@n-api.service[62042]: Connection: close Apr 12 06:58:12 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 06:58:12 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 06:58:12 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 06:58:12 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 06:58:12 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlQBTcGdqOWqyz1wTJwyAfw1Z5VtQDH02OzFjOsBkajEFEPiLzT5NncWvhQkPYcydonmjF8tBZvm-hFlPNM1LKE0TqQiifsN4OZYXkFl1OOqIsT4lI9gTLCxDFNcbeJz5GNPBDH6P0_X-QURs2SZi1v8dVCSRJarizdEqsfCaYEroTA Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Project-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}] Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Tenant: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Tenant-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:58:12 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:58:12 user devstack@n-api.service[62042]: X-User: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:58:12 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 06:58:12 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 06:58:12 user devstack@n-api.service[62042]: X-User-Id: 2a188723ace3460792ed32d13bfe0d93 Apr 12 06:58:12 user devstack@n-api.service[62042]: X-User-Name: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:58:12 user devstack@n-api.service[62042]: method: > Apr 12 06:58:12 user devstack@n-api.service[62042]: exception: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is not attached to volume 98d566ec-564b-4062-9a9a-09066ee60704 Apr 12 06:58:12 user devstack@n-api.service[62042]: action_args: {'server_id': '6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4', 'id': '98d566ec-564b-4062-9a9a-09066ee60704'} Apr 12 06:58:12 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 98d566ec-564b-4062-9a9a-09066ee60704. Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is not attached to volume 98d566ec-564b-4062-9a9a-09066ee60704 Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is not attached to volume 98d566ec-564b-4062-9a9a-09066ee60704 Apr 12 06:58:12 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 06:58:12 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Returning 404 to user: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is not attached to volume 98d566ec-564b-4062-9a9a-09066ee60704 {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:58:12 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-47ca337f-bf55-4f25-b424-bc72fb52ef0d tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments/98d566ec-564b-4062-9a9a-09066ee60704" status: 404 len: 154 microversion: 2.1 time: 0.124693 Apr 12 06:58:12 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 369/1105] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 06:58:12 2023] DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/os-volume_attachments/98d566ec-564b-4062-9a9a-09066ee60704 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=12 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:14 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:58:14 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 204 len: 0 microversion: 2.1 time: 0.141138 Apr 12 06:58:14 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 370/1106] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:58:14 2023] DELETE /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:14 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:58:14 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-0517d13f-6b96-4543-817e-785774988906 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 200 len: 1542 microversion: 2.1 time: 0.182374 Apr 12 06:58:14 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 368/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:58:14 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:58:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:58:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Creating event network-vif-unplugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:58:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040384 Apr 12 06:58:14 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 370/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:58:16 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}, {"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}, {"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}, {"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-plugged", "status": "completed", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}, {"server_uuid": "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4", "name": "network-vif-deleted", "tag": "b99eaecc-c588-46cb-84bf-10c63272eebf"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:58:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:16 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:58:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:58:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:58:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Creating event network-vif-plugged:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:58:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Creating event network-vif-deleted:b99eaecc-c588-46cb-84bf-10c63272eebf for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 on user Apr 12 06:58:17 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.031563 Apr 12 06:58:17 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 371/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=12 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:58:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:58:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-b0e836d0-97af-4615-bf72-49636e8cf5d9 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1707 microversion: 2.20 time: 0.170752 Apr 12 06:58:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 369/1110] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:58:38 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1707 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:58:38 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:58:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-0a11d2b2-98ae-45dc-91a3-a9ab3151ff78 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 200 len: 1441 microversion: 2.1 time: 0.169850 Apr 12 06:58:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 371/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:58:38 2023] GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 1441 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:59:04 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:04 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HTTP exception thrown: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 could not be found. Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Request method failure captured: Apr 12 06:59:05 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 HTTP/1.1 Apr 12 06:59:05 user devstack@n-api.service[62041]: Accept: application/json Apr 12 06:59:05 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 06:59:05 user devstack@n-api.service[62041]: Connection: close Apr 12 06:59:05 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 06:59:05 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 06:59:05 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 06:59:05 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 06:59:05 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlQBTcGdqOWqyz1wTJwyAfw1Z5VtQDH02OzFjOsBkajEFEPiLzT5NncWvhQkPYcydonmjF8tBZvm-hFlPNM1LKE0TqQiifsN4OZYXkFl1OOqIsT4lI9gTLCxDFNcbeJz5GNPBDH6P0_X-QURs2SZi1v8dVCSRJarizdEqsfCaYEroTA Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Project-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Project-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1aacffb9fbd4398b98db1f1945138dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1aacffb9fbd4398b98db1f1945138dc"}]}] Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Tenant: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Tenant-Id: d1aacffb9fbd4398b98db1f1945138dc Apr 12 06:59:05 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1474504992 Apr 12 06:59:05 user devstack@n-api.service[62041]: X-User: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:59:05 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 06:59:05 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 06:59:05 user devstack@n-api.service[62041]: X-User-Id: 2a188723ace3460792ed32d13bfe0d93 Apr 12 06:59:05 user devstack@n-api.service[62041]: X-User-Name: tempest-TestMinimumBasicScenario-1474504992-project-member Apr 12 06:59:05 user devstack@n-api.service[62041]: method: > Apr 12 06:59:05 user devstack@n-api.service[62041]: exception: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 could not be found. Apr 12 06:59:05 user devstack@n-api.service[62041]: action_args: {'id': '6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4'} Apr 12 06:59:05 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 could not be found. Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 could not be found. Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 could not be found. Apr 12 06:59:05 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 06:59:05 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Returning 404 to user: Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 06:59:05 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-20ce5d9a-cb9d-4c80-9f5c-c1507039d93a tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" status: 404 len: 111 microversion: 2.1 time: 0.122762 Apr 12 06:59:05 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 372/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:59:04 2023] GET /compute/v2.1/servers/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 06:59:05 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-39ade23f-78bc-4123-beb1-be382ec7740b tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Calling method '.version_select at 0x7fd24ddf9d80>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:05 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:05 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-39ade23f-78bc-4123-beb1-be382ec7740b tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-709112217" status: 202 len: 0 microversion: 2.1 time: 0.026927 Apr 12 06:59:05 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 370/1113] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 12 06:59:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-709112217 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:38 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:38 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-c36b4e16-a09c-4290-b483-848ec5b1ad41 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050208 Apr 12 06:59:38 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 372/1114] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 06:59:38 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:38 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:59:38 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 204 len: 0 microversion: 2.20 time: 0.122133 Apr 12 06:59:38 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 373/1115] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 06:59:38 2023] DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:59:38 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:59:38 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-575f5f68-09e2-499b-9cb3-e6d21862a17d tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 200 len: 1713 microversion: 2.20 time: 0.220766 Apr 12 06:59:38 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 371/1116] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 06:59:38 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 1713 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 06:59:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-unplugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:59:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Creating event network-vif-unplugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:59:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028490 Apr 12 06:59:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 374/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:39 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:59:39 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d224f8a2-0b18-44b8-b6cc-da9343788471 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 200 len: 1441 microversion: 2.1 time: 0.514319 Apr 12 06:59:39 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 373/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:59:38 2023] GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 1441 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 06:59:40 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-deleted", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:59:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:40 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] Creating event network-vif-deleted:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:59:40 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Apr 12 06:59:40 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 372/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:59:41 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666a910-9199-4582-8eb7-7b3b6263a535", "name": "network-vif-plugged", "status": "completed", "tag": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:59:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:41 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Creating event network-vif-plugged:195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance 3666a910-9199-4582-8eb7-7b3b6263a535 on user Apr 12 06:59:41 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Apr 12 06:59:41 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 375/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:41 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Going to try to terminate instance {{(pid=62042) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 06:59:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 204 len: 0 microversion: 2.1 time: 0.117595 Apr 12 06:59:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 374/1121] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 06:59:41 2023] DELETE /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:41 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 06:59:41 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-066f05f7-0b8d-49fd-bd7f-0cec59c74c4d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 200 len: 1447 microversion: 2.1 time: 0.227546 Apr 12 06:59:41 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 373/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 06:59:41 2023] GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 06:59:43 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}, {"server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "name": "network-vif-unplugged", "status": "completed", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}, {"server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "name": "network-vif-plugged", "status": "completed", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:59:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:43 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Creating event network-changed:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:59:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Creating event network-vif-unplugged:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:59:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Creating event network-vif-plugged:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:59:43 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.031852 Apr 12 06:59:43 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 376/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:59:43 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 06:59:43 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6641505-1353-4e5f-a8bb-935b9dc0c1be", "name": "network-vif-deleted", "tag": "ec21e1c6-11af-41ef-a200-42c0e932fec7"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 06:59:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 06:59:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 06:59:43 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 06:59:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] Creating event network-vif-deleted:ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be on user Apr 12 06:59:43 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033430 Apr 12 06:59:43 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 375/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 06:59:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=14 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HTTP exception thrown: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Request method failure captured: Apr 12 07:00:29 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 HTTP/1.1 Apr 12 07:00:29 user devstack@n-api.service[62040]: Accept: application/json Apr 12 07:00:29 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 07:00:29 user devstack@n-api.service[62040]: Connection: close Apr 12 07:00:29 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 07:00:29 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 07:00:29 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 07:00:29 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 07:00:29 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlPQYbntyM8nsHN8UwppDvju43uJTplHC5OfARBaETQZTSr3TWZQjB0l5Ta8IrFXzHwixdIz1MCQ3UuinQXvpxE5BizXqmsKlifVAM5IR07HkeqmCxs3ePpSshNp5Pf-8FMPhkXZh_f5Ij4DXgHvcwP_2HO63h64b6muic55A3eFxkI Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Project-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}] Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Tenant-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:29 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 07:00:29 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 07:00:29 user devstack@n-api.service[62040]: X-User-Id: 4fbb8c37e5a74a0b83011c2a21033204 Apr 12 07:00:29 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:29 user devstack@n-api.service[62040]: method: > Apr 12 07:00:29 user devstack@n-api.service[62040]: exception: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:29 user devstack@n-api.service[62040]: action_args: {'id': '3666a910-9199-4582-8eb7-7b3b6263a535'} Apr 12 07:00:29 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:29 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:29 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Returning 404 to user: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:00:29 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-69684e11-12f4-4f2b-b3eb-bc8a0db7c3ef tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 404 len: 111 microversion: 2.20 time: 0.045501 Apr 12 07:00:29 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 374/1125] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:00:29 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:00:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:29 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:29 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f1e03e5f-007f-471c-ba21-d3abc0a26894 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '.version_select at 0x7fd24dacd000>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:29 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f1e03e5f-007f-471c-ba21-d3abc0a26894 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503210292" status: 204 len: 0 microversion: 2.20 time: 0.031753 Apr 12 07:00:29 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 377/1126] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 07:00:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503210292 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 07:00:31 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be HTTP/1.1 Apr 12 07:00:31 user devstack@n-api.service[62042]: Accept: application/json Apr 12 07:00:31 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 07:00:31 user devstack@n-api.service[62042]: Connection: close Apr 12 07:00:31 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 07:00:31 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 07:00:31 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 07:00:31 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 07:00:31 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:00:31 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:00:31 user devstack@n-api.service[62042]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:00:31 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 07:00:31 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 07:00:31 user devstack@n-api.service[62042]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 07:00:31 user devstack@n-api.service[62042]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:00:31 user devstack@n-api.service[62042]: method: > Apr 12 07:00:31 user devstack@n-api.service[62042]: exception: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:00:31 user devstack@n-api.service[62042]: action_args: {'id': 'f6641505-1353-4e5f-a8bb-935b9dc0c1be'} Apr 12 07:00:31 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:00:31 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:00:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-2cf12961-97b4-4781-bed0-3dad1bb4f6fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 404 len: 111 microversion: 2.1 time: 0.047090 Apr 12 07:00:31 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 376/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:00:31 2023] GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1873720950", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1253801261", "security_groups": [{"name": "tempest-secgroup-smoke-1366870723"}], "block_device_mapping_v2": [{"uuid": "1640bd09-1264-4e82-9e6e-0f1fa3cc654b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a"}]}} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HTTP exception thrown: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Request method failure captured: Apr 12 07:00:32 user devstack@n-api.service[62041]: request: DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 HTTP/1.1 Apr 12 07:00:32 user devstack@n-api.service[62041]: Accept: application/json Apr 12 07:00:32 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 07:00:32 user devstack@n-api.service[62041]: Connection: close Apr 12 07:00:32 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 07:00:32 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 07:00:32 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 07:00:32 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 07:00:32 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlPQYbntyM8nsHN8UwppDvju43uJTplHC5OfARBaETQZTSr3TWZQjB0l5Ta8IrFXzHwixdIz1MCQ3UuinQXvpxE5BizXqmsKlifVAM5IR07HkeqmCxs3ePpSshNp5Pf-8FMPhkXZh_f5Ij4DXgHvcwP_2HO63h64b6muic55A3eFxkI Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Project-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}] Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Tenant-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-User: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:32 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 07:00:32 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 07:00:32 user devstack@n-api.service[62041]: X-User-Id: 4fbb8c37e5a74a0b83011c2a21033204 Apr 12 07:00:32 user devstack@n-api.service[62041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:32 user devstack@n-api.service[62041]: method: > Apr 12 07:00:32 user devstack@n-api.service[62041]: exception: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62041]: action_args: {'id': '3666a910-9199-4582-8eb7-7b3b6263a535'} Apr 12 07:00:32 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Returning 404 to user: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:00:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-7da9d420-9fa9-4c73-b1d3-e0e55f16a0aa tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 404 len: 111 microversion: 2.20 time: 0.028218 Apr 12 07:00:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 378/1128] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:00:32 2023] DELETE /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HTTP exception thrown: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Request method failure captured: Apr 12 07:00:32 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 HTTP/1.1 Apr 12 07:00:32 user devstack@n-api.service[62042]: Accept: application/json Apr 12 07:00:32 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 07:00:32 user devstack@n-api.service[62042]: Connection: close Apr 12 07:00:32 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 07:00:32 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 07:00:32 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 07:00:32 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 07:00:32 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlPQYbntyM8nsHN8UwppDvju43uJTplHC5OfARBaETQZTSr3TWZQjB0l5Ta8IrFXzHwixdIz1MCQ3UuinQXvpxE5BizXqmsKlifVAM5IR07HkeqmCxs3ePpSshNp5Pf-8FMPhkXZh_f5Ij4DXgHvcwP_2HO63h64b6muic55A3eFxkI Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Project-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}] Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Tenant-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:32 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 07:00:32 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 07:00:32 user devstack@n-api.service[62042]: X-User-Id: 4fbb8c37e5a74a0b83011c2a21033204 Apr 12 07:00:32 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:32 user devstack@n-api.service[62042]: method: > Apr 12 07:00:32 user devstack@n-api.service[62042]: exception: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62042]: action_args: {'id': '3666a910-9199-4582-8eb7-7b3b6263a535'} Apr 12 07:00:32 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. Apr 12 07:00:32 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:32 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Returning 404 to user: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:00:32 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-baaba5c9-307e-4faf-b533-b250bc075eca tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535" status: 404 len: 111 microversion: 2.20 time: 0.030985 Apr 12 07:00:32 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 377/1129] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:00:32 2023] GET /compute/v2.1/servers/3666a910-9199-4582-8eb7-7b3b6263a535 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] validate_networks() for [('9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a', None, None, None, None, None)] {{(pid=62040) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.quota [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Going to run 1 instances... {{(pid=62040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:00:32 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1640bd09-1264-4e82-9e6e-0f1fa3cc654b',volume_size=None,volume_type=None)] {{(pid=62040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:00:32 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.836416 Apr 12 07:00:32 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 375/1130] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:00:32 2023] POST /compute/v2.1/servers => generated 404 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-4d5b330a-497c-41c8-9944-e134ba115588 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-4d5b330a-497c-41c8-9944-e134ba115588 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:32 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-4d5b330a-497c-41c8-9944-e134ba115588 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:00:32 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-4d5b330a-497c-41c8-9944-e134ba115588 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa" status: 200 len: 1090 microversion: 2.1 time: 0.070187 Apr 12 07:00:32 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 379/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:00:32 2023] GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa => generated 1090 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HTTP exception thrown: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Request method failure captured: Apr 12 07:00:34 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 HTTP/1.1 Apr 12 07:00:34 user devstack@n-api.service[62042]: Accept: application/json Apr 12 07:00:34 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 07:00:34 user devstack@n-api.service[62042]: Connection: close Apr 12 07:00:34 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 07:00:34 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 07:00:34 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 07:00:34 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 07:00:34 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlPQYbntyM8nsHN8UwppDvju43uJTplHC5OfARBaETQZTSr3TWZQjB0l5Ta8IrFXzHwixdIz1MCQ3UuinQXvpxE5BizXqmsKlifVAM5IR07HkeqmCxs3ePpSshNp5Pf-8FMPhkXZh_f5Ij4DXgHvcwP_2HO63h64b6muic55A3eFxkI Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Project-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}] Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Tenant-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-User: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:34 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 07:00:34 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 07:00:34 user devstack@n-api.service[62042]: X-User-Id: 4fbb8c37e5a74a0b83011c2a21033204 Apr 12 07:00:34 user devstack@n-api.service[62042]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:34 user devstack@n-api.service[62042]: method: > Apr 12 07:00:34 user devstack@n-api.service[62042]: exception: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62042]: action_args: {'id': '02209375-f25a-4d51-9828-3422144c2ed8'} Apr 12 07:00:34 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Returning 404 to user: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:00:34 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-67796647-8d16-4390-a112-c6a3dc422d47 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 404 len: 111 microversion: 2.20 time: 0.039055 Apr 12 07:00:34 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 378/1132] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 07:00:34 2023] DELETE /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HTTP exception thrown: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Request method failure captured: Apr 12 07:00:34 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 HTTP/1.1 Apr 12 07:00:34 user devstack@n-api.service[62040]: Accept: application/json Apr 12 07:00:34 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 07:00:34 user devstack@n-api.service[62040]: Connection: close Apr 12 07:00:34 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 07:00:34 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 07:00:34 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 07:00:34 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 07:00:34 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlPQYbntyM8nsHN8UwppDvju43uJTplHC5OfARBaETQZTSr3TWZQjB0l5Ta8IrFXzHwixdIz1MCQ3UuinQXvpxE5BizXqmsKlifVAM5IR07HkeqmCxs3ePpSshNp5Pf-8FMPhkXZh_f5Ij4DXgHvcwP_2HO63h64b6muic55A3eFxkI Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Project-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76a8460ce5c24d1db20e80a1659133f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76a8460ce5c24d1db20e80a1659133f7"}]}] Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Tenant-Id: 76a8460ce5c24d1db20e80a1659133f7 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986658224 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-User: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:34 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 07:00:34 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 07:00:34 user devstack@n-api.service[62040]: X-User-Id: 4fbb8c37e5a74a0b83011c2a21033204 Apr 12 07:00:34 user devstack@n-api.service[62040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986658224-project-member Apr 12 07:00:34 user devstack@n-api.service[62040]: method: > Apr 12 07:00:34 user devstack@n-api.service[62040]: exception: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62040]: action_args: {'id': '02209375-f25a-4d51-9828-3422144c2ed8'} Apr 12 07:00:34 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. Apr 12 07:00:34 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:00:34 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Returning 404 to user: Instance 02209375-f25a-4d51-9828-3422144c2ed8 could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:00:34 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-3e1b7359-e427-4045-a23b-888454bfa2fc tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8" status: 404 len: 111 microversion: 2.20 time: 0.031434 Apr 12 07:00:34 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 376/1133] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 07:00:34 2023] GET /compute/v2.1/servers/02209375-f25a-4d51-9828-3422144c2ed8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 07:00:35 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:00:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:35 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Creating event network-changed:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:00:35 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105690 Apr 12 07:00:35 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 380/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:00:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:00:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "name": "network-vif-plugged", "status": "completed", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:00:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Creating event network-vif-plugged:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:00:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071547 Apr 12 07:00:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 379/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:00:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:00:43 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "name": "network-vif-plugged", "status": "completed", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:00:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:43 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell0:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:00:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:00:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:00:43 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:00:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Creating event network-vif-plugged:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:00:43 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061437 Apr 12 07:00:43 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 377/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:01:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:01:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:01:22 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:01:22 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:01:23 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:01:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-8ac04ef9-ea79-4ebb-8ee5-f2444f254142 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa" status: 200 len: 1442 microversion: 2.1 time: 0.170049 Apr 12 07:01:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 381/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:01:22 2023] GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:02:23 user devstack@n-api.service[62042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 07:02:23 user devstack@n-api.service[62042]: Wed Apr 12 07:02:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa (ip 10.0.0.210) !!! Apr 12 07:02:23 user devstack@n-api.service[62042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 07:02:23 user devstack@n-api.service[62042]: Wed Apr 12 07:02:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa (ip 10.0.0.210) !!! Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:23 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:02:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-da6c9a06-0abc-4b95-8103-e8b6dbe92863 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa" status: 200 len: 1442 microversion: 2.1 time: 0.199128 Apr 12 07:02:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 380/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:02:23 2023] GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa => generated 1442 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:02:24 user devstack@n-api.service[62040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 07:02:24 user devstack@n-api.service[62040]: Wed Apr 12 07:02:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 07:02:24 user devstack@n-api.service[62040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2cb98361-242e-45b7-b001-fed26627829c] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 07:02:24 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:24 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=8 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:24 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:02:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:24 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Creating event network-changed:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:02:25 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078063 Apr 12 07:02:25 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 378/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-321254683", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1253801261", "security_groups": [{"name": "tempest-secgroup-smoke-1366870723"}], "block_device_mapping_v2": [{"uuid": "6836b4d5-ab04-46f5-bd65-97daf28c5c63", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a"}]}} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] validate_networks() for [('9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a', None, None, None, None, None)] {{(pid=62041) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.quota [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting quotas for user 1fec39f776464d339142eeed1ba95a6d and project 13d1513e8b784c758412ddfc2692bb22. Resources: {'cores', 'ram', 'instances'} {{(pid=62041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Going to run 1 instances... {{(pid=62041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 07:02:30 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6836b4d5-ab04-46f5-bd65-97daf28c5c63',volume_size=None,volume_type=None)] {{(pid=62041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 07:02:31 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.042089 Apr 12 07:02:31 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 382/1140] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 07:02:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 07:02:31 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-d9d13dd9-9f9e-4a2f-b1b4-11bd52ef17b6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:02:31 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-d9d13dd9-9f9e-4a2f-b1b4-11bd52ef17b6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:02:31 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-d9d13dd9-9f9e-4a2f-b1b4-11bd52ef17b6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:02:31 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-d9d13dd9-9f9e-4a2f-b1b4-11bd52ef17b6 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" status: 200 len: 1089 microversion: 2.1 time: 0.068779 Apr 12 07:02:31 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 381/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:02:31 2023] GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:02:33 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:02:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:33 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Creating event network-changed:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:02:33 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038290 Apr 12 07:02:33 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 379/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:02:39 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "name": "network-vif-plugged", "status": "completed", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:02:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:39 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Creating event network-vif-plugged:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:02:39 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048671 Apr 12 07:02:39 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 383/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:02:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "name": "network-vif-plugged", "status": "completed", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=6 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell0:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:02:41 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:02:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Creating event network-vif-plugged:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:02:41 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065842 Apr 12 07:02:41 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 382/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:02:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:03:21 user devstack@n-api.service[62040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 07:03:21 user devstack@n-api.service[62040]: Wed Apr 12 07:03:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 (ip 10.0.0.210) !!! Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:03:21 user devstack@n-api.service[62040]: INFO oslo.messaging._drivers.impl_rabbit [-] [2cb98361-242e-45b7-b001-fed26627829c] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37468. Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:03:21 user devstack@n-api.service[62040]: DEBUG nova.policy [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62040) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:03:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-35db9520-b88e-4341-8f67-515216d98a89 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" status: 200 len: 1441 microversion: 2.1 time: 0.245112 Apr 12 07:03:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 380/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:03:21 2023] GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => generated 1441 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 07:04:21 user devstack@n-api.service[62041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41329b5a-c53a-461e-a8f1-1a58ed515660] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=2 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell0:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=4 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:21 user devstack@n-api.service[62041]: DEBUG nova.policy [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62041) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:04:21 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-f1a9458c-9545-425b-a88f-3947cc1d1e8b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" status: 200 len: 1441 microversion: 2.1 time: 0.177725 Apr 12 07:04:21 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 384/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:04:21 2023] GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => generated 1441 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=2 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.compute.server_external_events [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Creating event network-changed:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:04:23 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046169 Apr 12 07:04:23 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 383/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=2 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=6 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:04:23 user devstack@n-api.service[62041]: INFO oslo.messaging._drivers.impl_rabbit [-] [41329b5a-c53a-461e-a8f1-1a58ed515660] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42028. Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:23 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Going to try to terminate instance {{(pid=62040) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:04:23 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:04:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:23 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Creating event network-changed:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:04:23 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097181 Apr 12 07:04:23 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 385/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:04:23 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" status: 204 len: 0 microversion: 2.1 time: 0.130520 Apr 12 07:04:23 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 381/1149] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:04:23 2023] DELETE /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:23 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:24 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:04:24 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-4c2aa9b1-0d5a-433c-bc13-306a9a80627a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" status: 200 len: 1447 microversion: 2.1 time: 0.185248 Apr 12 07:04:24 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 384/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:04:23 2023] GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:04:25 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "name": "network-vif-unplugged", "status": "completed", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}, {"server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "name": "network-vif-plugged", "status": "completed", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:04:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:25 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Creating event network-vif-unplugged:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:04:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.compute.server_external_events [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Creating event network-vif-plugged:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:04:25 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035063 Apr 12 07:04:25 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 386/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:04:27 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4", "name": "network-vif-deleted", "tag": "1650e68d-e118-40ee-90dd-608846dcf213"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:04:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:04:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:04:27 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:04:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] Creating event network-vif-deleted:1650e68d-e118-40ee-90dd-608846dcf213 for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 on user Apr 12 07:04:27 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030457 Apr 12 07:04:27 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 382/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:04:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d01c8de3-72eb-4e64-b0b1-8f9c4d00a7a3] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 could not be found. Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 07:05:14 user devstack@n-api.service[62042]: request: GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 HTTP/1.1 Apr 12 07:05:14 user devstack@n-api.service[62042]: Accept: application/json Apr 12 07:05:14 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 07:05:14 user devstack@n-api.service[62042]: Connection: close Apr 12 07:05:14 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 07:05:14 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 07:05:14 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 07:05:14 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 07:05:14 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:05:14 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:05:14 user devstack@n-api.service[62042]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:05:14 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 07:05:14 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 07:05:14 user devstack@n-api.service[62042]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 07:05:14 user devstack@n-api.service[62042]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:05:14 user devstack@n-api.service[62042]: method: > Apr 12 07:05:14 user devstack@n-api.service[62042]: exception: Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 could not be found. Apr 12 07:05:14 user devstack@n-api.service[62042]: action_args: {'id': 'f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4'} Apr 12 07:05:14 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 could not be found. Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 could not be found. Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 could not be found. Apr 12 07:05:14 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:05:14 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:05:14 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3ea79482-66c3-4ec8-9f45-ac0f99d69be8 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" status: 404 len: 111 microversion: 2.1 time: 0.100679 Apr 12 07:05:14 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 385/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:05:14 2023] GET /compute/v2.1/servers/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=6 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=10 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:05:19 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:05:19 user devstack@n-api.service[62041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 07:05:19 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:05:19 user devstack@n-api.service[62041]: Wed Apr 12 07:05:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa (ip 10.0.0.210) !!! Apr 12 07:05:19 user devstack@n-api.service[62041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 07:05:19 user devstack@n-api.service[62041]: Wed Apr 12 07:05:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa (ip 10.0.0.210) !!! Apr 12 07:05:19 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:19 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Creating event network-changed:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:05:19 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036773 Apr 12 07:05:19 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 383/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:05:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 07:05:19 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Going to try to terminate instance {{(pid=62041) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 07:05:19 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa" status: 204 len: 0 microversion: 2.1 time: 0.136615 Apr 12 07:05:19 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 387/1155] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:05:19 2023] DELETE /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:19 user devstack@n-api.service[62042]: INFO oslo.messaging._drivers.impl_rabbit [-] [d01c8de3-72eb-4e64-b0b1-8f9c4d00a7a3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38120. Apr 12 07:05:19 user devstack@n-api.service[62042]: DEBUG nova.policy [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62042) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 07:05:19 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-3e8413d1-0ee0-4e9b-8033-12c91e7e4418 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa" status: 200 len: 1567 microversion: 2.1 time: 0.252235 Apr 12 07:05:19 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 386/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:05:19 2023] GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 07:05:21 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "name": "network-vif-unplugged", "status": "completed", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}, {"server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "name": "network-vif-plugged", "status": "completed", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}, {"server_uuid": "e50420bc-12f0-40bd-82bc-d91f38fe3eaa", "name": "network-vif-deleted", "tag": "db6994d3-6239-4f48-b696-63d53248e164"}]} {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 07:05:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:05:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:05:21 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:05:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Creating event network-vif-unplugged:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:05:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Creating event network-vif-plugged:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:05:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.compute.server_external_events [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Creating event network-vif-deleted:db6994d3-6239-4f48-b696-63d53248e164 for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa on user Apr 12 07:05:21 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034516 Apr 12 07:05:21 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 384/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 07:05:21 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG nova.compute.api [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Fetching instance by UUID {{(pid=62041) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG dbcounter [-] [62041] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=62041) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG oslo_concurrency.lockutils [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62041) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:06:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.wsgi [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa could not be found. Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 07:06:10 user devstack@n-api.service[62041]: request: GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa HTTP/1.1 Apr 12 07:06:10 user devstack@n-api.service[62041]: Accept: application/json Apr 12 07:06:10 user devstack@n-api.service[62041]: Accept-Encoding: identity Apr 12 07:06:10 user devstack@n-api.service[62041]: Connection: close Apr 12 07:06:10 user devstack@n-api.service[62041]: Content-Length: 0 Apr 12 07:06:10 user devstack@n-api.service[62041]: Content-Type: application/json Apr 12 07:06:10 user devstack@n-api.service[62041]: Host: 10.0.0.210 Apr 12 07:06:10 user devstack@n-api.service[62041]: Openstack-System-Scope: None Apr 12 07:06:10 user devstack@n-api.service[62041]: User-Agent: python-urllib3/1.26.15 Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Domain-Id: None Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Domain-Name: None Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Identity-Status: Confirmed Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Is-Admin-Project: True Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Project-Domain-Id: default Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Project-Domain-Name: Default Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Role: reader,member Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Roles: reader,member Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:06:10 user devstack@n-api.service[62041]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62041]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:06:10 user devstack@n-api.service[62041]: X-User-Domain-Id: default Apr 12 07:06:10 user devstack@n-api.service[62041]: X-User-Domain-Name: Default Apr 12 07:06:10 user devstack@n-api.service[62041]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 07:06:10 user devstack@n-api.service[62041]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:06:10 user devstack@n-api.service[62041]: method: > Apr 12 07:06:10 user devstack@n-api.service[62041]: exception: Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa could not be found. Apr 12 07:06:10 user devstack@n-api.service[62041]: action_args: {'id': 'e50420bc-12f0-40bd-82bc-d91f38fe3eaa'} Apr 12 07:06:10 user devstack@n-api.service[62041]: {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa could not be found. Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa could not be found. Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa could not be found. Apr 12 07:06:10 user devstack@n-api.service[62041]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa could not be found. {{(pid=62041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:06:10 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-2c79e43a-f4a9-462e-9a1f-cb148c679bc0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa" status: 404 len: 111 microversion: 2.1 time: 0.045877 Apr 12 07:06:10 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 388/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:06:10 2023] GET /compute/v2.1/servers/e50420bc-12f0-40bd-82bc-d91f38fe3eaa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG nova.compute.api [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62042) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_api:SELECT=4 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG dbcounter [-] [62042] Writing DB stats nova_cell1:SELECT=8 {{(pid=62042) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG oslo_concurrency.lockutils [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62042) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:06:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.wsgi [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 07:06:10 user devstack@n-api.service[62042]: request: DELETE /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be HTTP/1.1 Apr 12 07:06:10 user devstack@n-api.service[62042]: Accept: application/json Apr 12 07:06:10 user devstack@n-api.service[62042]: Accept-Encoding: identity Apr 12 07:06:10 user devstack@n-api.service[62042]: Connection: close Apr 12 07:06:10 user devstack@n-api.service[62042]: Content-Length: 0 Apr 12 07:06:10 user devstack@n-api.service[62042]: Content-Type: application/json Apr 12 07:06:10 user devstack@n-api.service[62042]: Host: 10.0.0.210 Apr 12 07:06:10 user devstack@n-api.service[62042]: Openstack-System-Scope: None Apr 12 07:06:10 user devstack@n-api.service[62042]: User-Agent: python-urllib3/1.26.15 Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Domain-Id: None Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Domain-Name: None Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Identity-Status: Confirmed Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Is-Admin-Project: True Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Project-Domain-Id: default Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Project-Domain-Name: Default Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Role: reader,member Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Roles: reader,member Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:06:10 user devstack@n-api.service[62042]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62042]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:06:10 user devstack@n-api.service[62042]: X-User-Domain-Id: default Apr 12 07:06:10 user devstack@n-api.service[62042]: X-User-Domain-Name: Default Apr 12 07:06:10 user devstack@n-api.service[62042]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 07:06:10 user devstack@n-api.service[62042]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:06:10 user devstack@n-api.service[62042]: method: > Apr 12 07:06:10 user devstack@n-api.service[62042]: exception: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62042]: action_args: {'id': 'f6641505-1353-4e5f-a8bb-935b9dc0c1be'} Apr 12 07:06:10 user devstack@n-api.service[62042]: {{(pid=62042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62042]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62042]: DEBUG nova.api.openstack.wsgi [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. {{(pid=62042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:06:10 user devstack@n-api.service[62042]: INFO nova.api.openstack.requestlog [None req-29e7a640-111a-42de-a0ec-245aa8080004 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 404 len: 111 microversion: 2.1 time: 0.035119 Apr 12 07:06:10 user devstack@n-api.service[62042]: [pid: 62042|app: 0|req: 387/1159] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 07:06:10 2023] DELETE /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_api:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG dbcounter [-] [62040] Writing DB stats nova_cell1:SELECT=4 {{(pid=62040) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '>' {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG nova.compute.api [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Fetching instance by UUID {{(pid=62040) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG oslo_concurrency.lockutils [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "453065c2-4bc8-4fda-9e5a-4e25f602658d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62040) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 07:06:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.wsgi [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HTTP exception thrown: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Request method failure captured: Apr 12 07:06:10 user devstack@n-api.service[62040]: request: GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be HTTP/1.1 Apr 12 07:06:10 user devstack@n-api.service[62040]: Accept: application/json Apr 12 07:06:10 user devstack@n-api.service[62040]: Accept-Encoding: identity Apr 12 07:06:10 user devstack@n-api.service[62040]: Connection: close Apr 12 07:06:10 user devstack@n-api.service[62040]: Content-Length: 0 Apr 12 07:06:10 user devstack@n-api.service[62040]: Content-Type: application/json Apr 12 07:06:10 user devstack@n-api.service[62040]: Host: 10.0.0.210 Apr 12 07:06:10 user devstack@n-api.service[62040]: Openstack-System-Scope: None Apr 12 07:06:10 user devstack@n-api.service[62040]: User-Agent: python-urllib3/1.26.15 Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Auth-Token: gAAAAABkNlRqdQwOlz1xSHCbIjBYHjZ7ExUkw6q_QgzepHY0uE-9wegpEzndA17xWJ2cNHJfZyWBnI63SqvKS9QcXjPpIRy5IrybvTQPMRkKHkBa547tvBWN7--yQ31G7184rPvBE5S564cvF0Ibvh4LOzSI9mM2R4Rih7nOLv0Uls7iHxzccvw Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Domain-Id: None Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Domain-Name: None Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Identity-Status: Confirmed Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Is-Admin-Project: True Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Project-Domain-Id: default Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Project-Domain-Name: Default Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Project-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Project-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Role: reader,member Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Roles: reader,member Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13d1513e8b784c758412ddfc2692bb22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13d1513e8b784c758412ddfc2692bb22"}]}] Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Tenant: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Tenant-Id: 13d1513e8b784c758412ddfc2692bb22 Apr 12 07:06:10 user devstack@n-api.service[62040]: X-Tenant-Name: tempest-TestVolumeBootPattern-294210775 Apr 12 07:06:10 user devstack@n-api.service[62040]: X-User: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:06:10 user devstack@n-api.service[62040]: X-User-Domain-Id: default Apr 12 07:06:10 user devstack@n-api.service[62040]: X-User-Domain-Name: Default Apr 12 07:06:10 user devstack@n-api.service[62040]: X-User-Id: 1fec39f776464d339142eeed1ba95a6d Apr 12 07:06:10 user devstack@n-api.service[62040]: X-User-Name: tempest-TestVolumeBootPattern-294210775-project-member Apr 12 07:06:10 user devstack@n-api.service[62040]: method: > Apr 12 07:06:10 user devstack@n-api.service[62040]: exception: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62040]: action_args: {'id': 'f6641505-1353-4e5f-a8bb-935b9dc0c1be'} Apr 12 07:06:10 user devstack@n-api.service[62040]: {{(pid=62040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. Apr 12 07:06:10 user devstack@n-api.service[62040]: ERROR nova.api.openstack.wsgi Apr 12 07:06:10 user devstack@n-api.service[62040]: DEBUG nova.api.openstack.wsgi [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Returning 404 to user: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. {{(pid=62040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 07:06:10 user devstack@n-api.service[62040]: INFO nova.api.openstack.requestlog [None req-8a7917da-69a4-40ba-98a7-e157315dcaba tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be" status: 404 len: 111 microversion: 2.1 time: 0.040904 Apr 12 07:06:10 user devstack@n-api.service[62040]: [pid: 62040|app: 0|req: 385/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 07:06:10 2023] GET /compute/v2.1/servers/f6641505-1353-4e5f-a8bb-935b9dc0c1be => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 07:06:13 user devstack@n-api.service[62041]: DEBUG nova.api.openstack.wsgi [None req-b60b68d6-6407-437b-a9b1-4a178488e939 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Calling method '.version_select at 0x7fd24dacd3f0>' {{(pid=62041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 07:06:13 user devstack@n-api.service[62041]: INFO nova.api.openstack.requestlog [None req-b60b68d6-6407-437b-a9b1-4a178488e939 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1253801261" status: 202 len: 0 microversion: 2.1 time: 0.026125 Apr 12 07:06:13 user devstack@n-api.service[62041]: [pid: 62041|app: 0|req: 389/1161] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 12 07:06:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1253801261 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)